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interdependence and Management of Bilingual Classrooms 

Final Report to NIE 



INTRODUCTION 

This is the final report on the first part of a two 
part secondary analysis. The first' analysis is a study of im- 
plementation and its relation to learning outcomes; the se- 
ts^* 

cond analysis we haye planned is a study of interdependence 
of staff, classroom management^ and the relationship of these 
variables to effective implementation. We have completed the 
first analysis in this year's work. 

A-major portion of this year's work lay in the sociolog- 
ical conceptualization of curriculum implementation. Using a 
general formulation of the concept, we have developed indica- 
tors of the relevant dimensions. The analysis consisted of .. 
applying chese ideas to a body of data collected on imple- 
mentation of a complex math-science curriculum designed for 
language minority children. The data are drawn from nine ele- 
mentary school .classrooms which used the curriculum. We have 
examined variation in implementation in these nine class- 
rooms and have related this variation to learning at both 
the classroom and individual *fevel. 

The analysis is far more than a straightforward evalua- 
tion^ curriculum effectiveness. We "already know that ex- 
periencing this curriculum was associated with significant 

♦ 
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gains- in science knowledge, math achievement test scores, 
reading achievement, and linguistic/ prof iciency (De Avila,- 
1981). In order to analyze implementation, we use the con- 
cept of technology. There are several dimensions which organ- 
izational sociologists use to characterize the complexity of 
technology. We have taken these dimensions and have charac- 
terized the math-science curriculum as originally planned 
and the observable .complexity of the curriculum as imple- 
men ted in the-; nine classrooms. 

The math-science curriculum we studied was originally 
planned as' complex instruction; it cavils for multiple learn- 
ing centers each with different materials and activities. 
Furthermore, these learning centers are designed to operate 
simultaneously in the classsroom with four or five children 
working at -each center, This is a far cry, technologically 
speaking, from traditional large group instruction^ 

• m addition, the curriculum requires the learners to 
. follow novel task instructions at multiple learning centers. 
From a sociological point of view, there is a goo* deal of 
task 'Uncertainty for the learner. ^ Unless the teacher finds 
some way to deal with this uncertainty, -many students will 
become confused and fail to benefit from their learning 
tasks. We have often heard this complaint from teachers who 
have tried t'o use multiple learning centers. 

- Simultaneous use of a wide variety of materials in a 
classroom offers great advantages for learning; it allows 
the teacher to adapt to students who are on different levels 



of acadenu^aehievemeht. In the case of the curriculum we 

(d, multiple media were u?ed in conjunction with multi- ( 

activities; this was done to allow children .at different 

levels of Cognitive development to benefit from the learning 

*' 

center tasks. This curriculum had the .additional feature of 

• <• » • • 

« • 

instructions at each ^learning center Appearing in English, 
Spanish and pictography f Although the bilingual character of 
the instructions increases the. complexity of the technology", 
it provides the kind of redundancy in communication which al- 
lows students who speak only Spanish and students who^have 
limited proficiency in both English and Spanish to under- 
stand What they must do without the special intervention of 
the teacher. 

, This curriculum represents a common problem of imple- 
mentation of innovative curricula requiring multiple materi- 
als,* media and activity centers. In order to«maintain effect- 
ive control over different students doing so many different 
things, the teaaher must either- delegate authprity to the 
learners themselves to manage much of their own behavior or 
cut down on the level of complexity to the point where rou- 
tine bureaucratic supervision will be effective in control- 
ling° behavior. If the teacher fails to delegate authority 
while maintaining a high level of complexity, s/ 6 he will not o 
be able to maintain any degree of control over what is, going ' 
on* 

Giving up the role of direct supervisor and .instructor 

is not easy for many teachers. They are concerned about loss 

• — 
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of control when students are engaged in so many different ac 

tivities. Science educators (and other developers of com-* 

* ** * 

plex instruction) have often observed the failure of teach- 
ers to use the curricula they prepare as originally design- 
ed.^The problem is also observable with ^jj^ricula designed 
for multiple groupings .of students in programs of individual 

ized instruction. Mcdonald^nd Elias report increased manage 

S . -\ 

ment problems associated with use of multiple materials in * 

■ # 

* 

individualized classrooms (197-5). « 

In thiSu analysis we can examine. the effect of delegat- 
ing authority to the children, allowing them to assist 

e 

each other) on learning outcomes. Some of the teachers in. 
our study made much more use of lateral relations between* 
the students than others. This analysis is of general °inter- 
est to ^educators working with complex instruction"; it yields 
0 information on the effectiveness of a pattern of classroom 
organization whfen on*e «is working with complete instruction. 

• In addition to this issu6, a second feature of. this an 
alysis is the detailed conceptualization of the implementa- 
tion- process. We examine the relationship of multiple dimen- 
sions of implementation to different learning outcomes. This 

0 

* analysis helps to pinpoinjt which features of classroom activ 

i . . » 

,ity and pupil- behavior arje most closely related to which 
kind of test outcomes. 

Other studies of implementation ■ led us to expect that 

* 

there would be significant deviations*- from the developer's 
original design , especially, in the direction of reducing com 



t ♦ 

plexity:. Our. conceptualization allowed us to examine how . 
,each classroom stood on multiple dimensions of implementa- . 
tion. We were able to study the power of each dimension to 
' predict learning outcomes* 

Through this -analysis we were & able to ascertain which 
features of the curriculum are absolutely essential to learn- 
ing and which design features may be altered according to in- 
dividual preference without appreciable loss of learning. 
Thi's procedure permits us to develop a set of general princi- 
ples for guiding the practitioner. S/he is free to adapt 
some features to her own style, but understands the risks in 
altering other features. c 

THEORETICAL FRAMEWORK 

r - • 

This section will introduce the sociological concepts 
and hypotheses -tested in the analyses reported • here. As de- 
scribed above there are two major, analyses: The first apaly- 
' «is tests the effectiveness -of a pattefn of classroom organ- 
ization for learning, given a well prepared set of curricu- 
lum materials which are designed to be used simultaneously; 
the second analysis examines the' relationship .of multiple di- 
mensions of implementation of the curriculum to learning out- 
comes at the classroom ? and individual level. 

Technology 

> ERJC # % . Page 5 j 



To sociologists the concept of technology do.es* not ne- 
cessarily imply use of machines. Rather it is a conception 
of a task as a series of means-end sequences (cf 
Waldo ,1969). Sociologists working at Stanford University in 
the Environment for Teaching Program, developed an applica- 
tion of the concept of technology to classroom instruction. 
The two major dimensions that have been found useful for an- 
alysis are: degree of differentiation and routinization of 
decision making. Classes are seen as more complex in their 
technology .to the extent that their activities are more dif- 
ferentiated and their implementation requires non-routine de- 
cision-making. 

In this view, the traditional method of teaching where 
the class is assigned a task as a whole or sits as a group, 
listening to the teacher talk, is similar to large batch pro- 
cessing in industry. The student completes the standardized 
task in the prescribed manner and attains the desired out- 
comes. Instruction of this type shows a low degree of dif- 
ferentiation and a low level of non-routine decision-making. 

1 In contrast, many of the elementary school classrooms 
studied by the Environment for Teaching had multiple matefi- 
als' and groups in simultaneous usage. As the method of in- 
struction utilizes multiple materials, activities and group- 
ing patterns simultaneously, the <.techno logy is said to be *\u 
"creasingly differentiated. The introduction of individualize 
tion techniques to the teaching of basic skills for the ele- 
mentary school has meant the rapid growth of a differentia- 
ls ' ~ Page 6 12 
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4«d> technology of teaching (See Cohen, Deal, Meyer 6 
Scott, 1979. for description of this trend.). - 
€b' The curriculum Finding. Out/bescrubrimiento , repre- 
? ^ oieiits. a highly differentiated technology. At any one time 
there are up to 12 learning centers in a classroom* Each 
lea thing center features an entirely different activity in- 
. vvolving its. bwn. set of goals, manipulable materials and work- 
• sheist^. The instructions are" available at each learning cen- 
v, Iter i* English, Spanish and in pictographs. Children are in 
°*-* k *ji variety of grouping patterns; Some are -working by them- 
:v selves; others are working together on worksheets or manipu- 
i&tihg materials together or talking over what they.itre to 
do at the learning center. These- groups may range from i two 
through five children. ^The size of the group is determined 
by the nature of the activities, the teacher's directions 
and the children's decisions. 

e The second dimension of technology, routinization of 
decision -making, refers to the way in which the workers) in 
charge of the operation .make decisions .about how the work 
vrxll be done, if a task has been standardized or if work is 
-governed by .a set of traditions as to "how things should be 
done,* then decision-making- is more routine, in the p third 
grade, for example, tradition dictates that everyone should 
lake* up the study of .fractions. Examples of non-routine de- 
cision-masking, in modern teaching methods are ^individualized 
instruction requiring the teacher to diagnose and prescribe 
for the needs of individual learners or open classrooms 



c 

where children are. allowed make many of the decisions for 
themselves. 

' In 'some -ways the instructional decison-making in Find- 
ing Out/Descrubrimiento is routinized. Each child is presen- 
ted with the same instructions and carefully prepared materi- 

• i tr 

als at a given learning center. Furthermore each child is 
supposed "to complete tasks at each center and fill oum the 
same worksheet. The tasks are designed so that children who 
vary in level of cognitive development will work tlje task 
somewhat differently. No task is set up so that children who 
are at a lower level of development are prevented from com- 
pleting *the activity. This design feature saves the teacher 
making decisions as to how to adjust the' character of the 
task 'for individual differences. 

* " There remain individual- differences the teacher- must 
take into account in running this curriculum. For example, 
there- are man"' non-readers; some provision must be made for • 
their understanding of. the instructions. Furthermore, some 
children require much more guidance than others in finding 
their way through a novel set of instructions. Some children 
will require more time and attention in feedback on their 
worksheets. From the curriculum developer's point of view an 
important role for the teacher is to extend the depth and 
cognitive level of the child's inquiry. Some students who. 
may be developmentally capable of dealing with the problem 
.on an advanced or more abstract level, will need to be en- 
couraged to 'do so by the teacher asking critical questions. 

. page 8 
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Thus if this curriculum is to be properly implemented teach,- 
er3 must still observe individuals and make non--routine. de- 
cisons about special attention and treatment they should re- 
ceive. 

In this year's analysis we make limited use of the con- 
cept of non-routine decision-making from the teacher's point 
of view. We have simply examined the extent to which she 
gave individuals special attention and treatment in the way 
the developer intended. 



Technology and Work Arrangements 



"As technology growsl in complexity, there is an in- 
crease in the use of lateral relations as channels for corns- 
municatipn (March & Simon, 1958; Van de Ven, A.H., et 
al.,1976). The function of - later: I relations is to deal with 
the uncertainty so characteristic of more complex tasks; peo- 
ple who talk with each other are much more likely to solve 
difficult problems than people who work by themselves. If 
these work arrangements do not shift to "match" the technolo 
qy, then productivity declines and there is a> loss of organi 
zational effectiveness (Perrow,1961) . These theorists argue 
that it 'is necessary to substitute horizontal communication 
and mutual adjustment for hierarchical" authority. 

Perrow's proposition is the basis for the first hypoth 
esis. We argue that the learning center tasks in the curricu 

Page 9 



lum. represent highly uncertain problems requiring solutions 
from the students. Each task is novel; the student must find 
his/her way through the instructions. in order to manipulate 
the materials' and fill out the worksheet. If the teacher 
fails to delegate authority to the children to use each oth- 
er as resources (lateral relations), we ; should see weaker of 
learning outcomes. This will happen because the teacher can- 



not be everywhere at once to provide resource^ necessary for 
the students to carry out their learning tasks. 
Hypothesis 1 

Given the high level of differentiation in 

♦ 

this curriculum, the frequency of lateral 

relations between students will be - 
associated with learning gains. 

0 

In the above hypothesis we have identified "Perrow,' s 
concept of "organizational effectiveness" with learning 
gains. The desired match between work arrangements and tech- 
nology occurs when the teacher delegates authority to later- 
al relations in dealing with the managerial problems pro- 
duced by a high level of differentiation. It should be point- 
ed out that we have taken the novel step of considering the 
lateral relations of the students as a work arrangement. As 
in other -studies of workers, we are. hypothesizing that the 
interdependence of student-workers serves to solve problems 
in connection with getting their "job" done. 

. Page 10 
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I mplementa tion and L«j>»rpina Outcomes 

y v • ' 

'Research on implementation of curricula reveals a pro- 

cess of adaptation in which it is common to find that the 
curriculum or program becomes almost^ unrecognizable as it is 
adapt'ed to local conditions... This insight has brought into 
question the earlier, practice of conceptualizing implementa- 
tion solely -in terms' of its "fidelity* -.to the developer's 
views of what ought to take place in the classrooms using 
that, curriculum. Fullan and others, 'have urged that the pro- 
cess of adaptation is '.a worthy subject of study for those 
who want to understand how changes take place in the prac- 
tices of educational organizations (Fullan, 1980 ) . 

jjur approach to the study of implementation has some 
aspects of the "fidelity" approach, although our major ques- 
tions resemble what Fullan and Berman have called the pro- 
grammed perspective (Fullan, 19*0j Berman, 1979) . The program- 
med approach to implementation consists of an explicit at- 

• tempt to assess the, degree of implementation over time with- 

If 

in a given population of users, and to use this information 
to identify variations of use in order to facilitate more 
faithful implementation or examine the relationship between 
implementation and student achievement. 

The sociological conceptualization of -the curriculum 
leads to. the expectation that the curriculum will be imple- 

• mented (or adapted) in different directions in different 
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classrooms, and that those directions are predictable by the • 
teacher's management strategies. The isaue of management of 

i 

the differentiation of the curriculum is likely to produce 
weaknesses in particular dimensions of implementation* We 

c 

can, predict that a major difference between classrooms will 
be in the level of differentiation that is maintained. If 
t he teacher is experiencing the management problems which of- 
ten accompany a high level of differentiation, some of them 
will undoubtedly try to 1 solve the problem by lowering the le- 
vel of differentiation. The < consequence of this particular 
adaptation will be less .complex instruction than the develop^ 
er-intended. Students will be working in larger groups under 
more direct supervision of the 'teacher and will not be able 
to work ( thing| out for themselves with as great a variety of 
1 media a^d activities. Thus there should, be a decrease in pro- 
ductive behavior on the part of the students. 

Using organizational sociology, we have conceptualized 
implementation so as to capture the ext-ent to which both pro- 
ductivity 'and differentiation are* maintained in each class- 
room.. Examining the "relationships between these dimensions 
and learning outcomes yields some r inf ormation about the 

e 

"costliness" of management problems 'and directs the develop- 
er to the critical issues of increased organizational supj 
p'ort for the teaching staff who are working with this curric- 
ulum. 

In review, this discussion proposes two dimensions of 
implementation of a highly differentiated and rationalized 



curriculum. Abstractly stated,' these are: productivity and 
level of differentiation. The level of differentiation re- 
fers to the observed extent to which different activi^ ^ 
ty/treatments/grouping patterns are in simultaneous opera- 
tion in the classroom. The productivity dimension refers 
to the outputs of student performance. 

In addition to these two dimensions "there is a third: 
prescribed learning behavior . This dimension refers to the 
developer's conception about^a, mediating learning process. 
This particular curriculum is based on an explicit rationale 
' about the conditions under which children will develop think- 
ing skills. The learning materials and the prescribed activi- 



ties are constructed to T ^n^"rm^o "tfie~developer J -s theory 

The data may or may not support'the develdper 5 s theory, but 
an evaluation of 'the curriculum may be taken as a -"test" of 
that theory. The dimension of prescribed -learning ' behavior , 
then, refers to the behaviors we should see- in a classroom 
if, from the developer's perspective, the students are using 
the curriculum materials and activities in the way that is 
supposed to promote learning. 

The three dimensions of implementation just described 
should be related to learning outcomes. In other words the 
extent to which the learner experiences a high level of dif- 
ferentiation, exhibits a higher level of productivity, is 

seen to be engaged in the prescribed learning behaviors 

all these should individually and collectively be related to 
learning outcomes. 
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H ypothesis 2 For a given level of pre- 
test scores, learning outcomes of the curri- 
culum will be related to the observed dif- 
ferentiation v productivity and frequency of 
mediating learning behaviors. 

' up to this point we/have stayed very ^close to the stu- 
dents and have not touched the teacher's role apart* from the 
'issues of management. However, this curriculum, it will be 
recalled, does require some non-routine decision making on 
the part of the teacher. The teacher is required to decide 

^ich-chi-i-dren-ar^^ and t0 6X " 

tend activities by asking questions. She was also re-quired- 
decide when children were in need of instruction and feed- 
back on their worksheets. The shift from direct instruction 
to- this kind of a pattern is precisely the kind of a role 
shift which causes so many programs and curricula to fail 
in the process of implementation <Fullan,1980) . 

Examination of the data should yield the answer to 
two questions: How successful was the in-service in persuad- 
ing the teacher to adopt the prescribed role? And, what is 
the relationship between the extent to which as given teach- 
' er played the prescribed role and learning outcomes? 

~ < T HE SETTING AND THE SAMPLE 
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Finding Out/Descrubrimiento was used in nirie bilin- 
gual classrooms, with* 307 students, in grades two through 
four. These represented' nine schools in six different dis- 
tricts, all*of which were part of the Bilingual Consortium 
of r San Jose. Each classroom was staffed with- a teacher and 
an aide. The sample of teach/ers participating consisted of 
volunteers recruited through oral presentation and a re- 
? cruitment questionnaire, to meet minimum implementation cri- 

i-eria. These criteria were a positive attitude toward use of 

* 

learning centers, availability of an aide who would work 
with the teacher in classroom instruction for at least three 
hours during the day; and' administrative support for the 
.teacher's involvement in the experiment. 



Two Conditions f~or~Teachers^ 



The sample of teachers participating in the program 
was divided into two experimental conditions the intensive 
and the economic. Five of the nine teacher-aide teams re- 
ceived special in-service, designed to improve the way they 

functioned* as a team the intensive condition. All nine 

teachers ^and seven of the nine aides were given a three day 
workshop, training them in the use of the activities. During 
this time they worked with the activities; the rationale un- 
deriving the program was explained; they practiced- the exten- 
sion of activities and drawing out of inferences we were ad- 
vocating; and they Jieard a description of t classroom manage- 
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*ent and record-keeping procedures. Much of the information 
was supplied in a handbook for teachers. A follow-up ses*- 
sion, conducted either in a group or individually, took 
place after the teachers had completed at least three weeks 
of the activities. 



The Students 



^hree hundred and seven students, in al-l-,--par^ipated 
in- the experience. This-number , however, includes about 30 
students who~c7meTn late, left early, or were generally ab- 
sent. The classes were made up largely of children of 
Hispanic background, with a small proportion' of Anglos, 
Blacks and Asians. Parental background was. working class and 
lower white collar. There were a few children from welfare 
-Tamrl-ies. We had been warned by the principals of the 
schools to expect a high proportion of . transient students, 
some from migrant families. Our absenteeism rates were well 
below what we expected. Tables 1 and 2 summarize the partici- 
pating sample, by grade and language proficiency. 

» 

v 

t 

TABLES 1 AND 2 HERE • 
. PROCEDURE 

Finding Out/nescrubrimento was designed for use an 
hour per day, four days a' week, for 14 weeks, all students 
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Were to complete each of the 170 e activities provided, along 
with the accompanying worksheets. lu practice, the activi- 
ties were used in classrooms for varying amounts of time per 
day, and days per week. 

in response to complaints from the teachers about the 
amount of work in handling 12 centers at a time, the project 
staff reduced the recommended numb'er to six per week. All 
learning center materials continued to be delivered to the 
classrooms, but the recommended centers- were so marked. Some 

t 

teachers incorporated the use of the activities into their 
other subject areas. They used the instruction for the activ- 
ities as part of the reading lesson. They selected the new 
scientific words for vocabulary development. Some used the 
math activities as part of their math lessons. Other teach- 
ers maintained a special segment of the day for the curricu- 
lum with no integration of its materials with the rest of 
the day's activities. Some classes finished all 14 weeks; 
others only half "that many. 

Before and after the curriculum, all classrooms , parti- 
cipated in test administration, allowing us to evaluate the 
learning outcomes. In addition, each classroom experienced - 
frequent visits from observers who collected systematic data 
"on "the process of implementation. 

MEASUREMENT SECTION " ' \ 
Instrumentation and Data Sou rces ;Overview 

f 
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The data bank on which 'this secondary analysis was per- 
formed contains a variety of measures taken over time and cn 
different, levels* In this section we will describe only the 
instruments used in the analysis; description will include 
procedure^ for data collection and reliability data* Detail- 
ed copies of these instruments and their manuals are includ- 
ed in the appendices to this technical report* 

Following this description of the 0 instruments is a dis- 
cussion of the general strategy used to test the hypotheses. 
We will also discuss how measures were aggregated across time 
for classrooms and individuals after assuring ourselves that 
there was sufficient stability in the measurements to permit 
aggregation* The statistical procedures t to be used will also 
be described* 

The description' of the specific indices used in the an- 
alyses will be included with the results because it is dif- 
ficult 'to keep in mind the nature of each of these complex in- 
dices* The source of each of "these indices in particular mea- 
suring instruments is specified; furthermore, the methods 
used to create an index are described. 

Description of Classroom Behavioral Instruments % 

There were three instruments designed to take systema- 
tic observational data in the classrooms during the course 

\ ■ 
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of the curriculum: one examined teacher behavior, one focus- 
'ed on individual student behavior, and a th^Lrd examined pat- 
terns of activities and grouping at the classroom level. 

* • 

These three instruments provided process measures of behav- 
ior of relevant actors at 'thfe classroom and individual level 
during' the implementation of the curriculum. 

Once a week, -from October through April, t^wo project 
staff members observed use of the curriculum activities in 
the classroom using these three instruments. Iri' addition to 
the observational, instruments we had an objective measure of 
the productive behavior of students. As a measure of the out- 
put of individuals/, we collected worksheets the children had 
'filled out in connection with 'the -learning centers. The aver- 
age number of worksheets per chiid is an important variable 
distinguishing classrooms in this analysis. In addition, 
quality of performance on these worksheets was scored for a 
subset of children in the; nine classrooms. 

. Teacher Behavior Instrument. We examined teacher be- 
havior through an instrument developed specifically for this 

0 

project. Unlike most available measures of classroom teacher 
behavior this . instrument focuses entirely on coordination, 
control, and instruction rather than on details such as the 
nature of teacher questions. In addition, this instrument 
counts the- number of different individuals- contacted by the 
teacher and the language used by the teacher in speaking to 
those individuals. 
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The teacher behavior instruct also provides speci- 
•fio measures of the extent tb which the teachers followed 
the developer's instructions on extending activities of indi- 
vidual children and providing specific feedback on work- , 
sheets. It also permits an examination of the effectiveness 
ana necessity of the teacher playing a direct instructional 
role as compared to the role of a manager and facilitator. 
This instrument was administered for a 15 minute period ever 
y time the observer visited the classroom. Selected behav- 
iors were checked off as they occurred. 

The reliability of this instrument was assessed in two 
phases, in the first phase, each classroom observer was 
paired with a supervisor who scored alongside the observer. 
„o observer was allowed to score on his/her own until a sat- 
isfactory level of Agreement with the supervisor's scoring 
was reached. This was calculated by comparing the total num- 
ber ot checks made by the observer and the supervisor for a 
scoring period for each category on the scoring instrument 
Th e formula used to- assess the level of agreement was: 

I a greements of scorer with rr. terion scorer ^ 
Total possible points of disagreement between two 
scorers." 

„o observers were allowed to visit classrooms on 
their own until they hid reached an acceptable level of 
agreement with the supervisor. This was defined as .90 

i 
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agreement. T^'^«up^*M.^[«j2fesJ B ?? l W r ^ Intili, who 
•cheated the, ihsttuine^fr'Se instrument was accompanied by a 
detaiie* scoring manual which is included in Appendix A. 

* • * 

During, the scoring, .each 'observer received two visits 

v - 

7from one of the supervisors. Reliability checks were made at 

Vhose times. Table 3. gives the results of the reliability 

checks made during the course of scoring* the Teacher Behav- 

.,ior, instrument. The level of agreement was- .90 or better in 

most cases-. 

< * * 

Wit'h this instrument, as with the other behavioral in- 
struments,we followed the. additional procedure 'of regular 
staff meetings at which difficult points .of scoring were dis- 
cussed; Sometimes these resulted in changes in the scoring^ 
manual.' -In these cases, we chose to improve the procedures 
even though scoring was already underway rather than, accept 
a faulty procedure. In no case did one of these changes in- 
•volve a variable used in this analysis. 

. INSERT TABLE 3 ABOUT HERE \ 
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Whole Class Observation Instrument. This instrument 
was an adaptation of the earlier work of the Environment for 
Teaching Program and 'the Status Equalization Project at Stan- 
ff. % . ford- (bpth supported by NIS) . . The observer checks of f the lo- 
• cation' of students and teacher (and aide) in a matrix made 

up of rows of grouping* patterns, and columns of activity ■ . 
*~types.. It is designed to provide an dverview of -the differen- 
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jgfci.tion of the technology and the occurrence of particular 
- pattern, and activities which are of .pecial interest to the ^ 
investigator. In this particular version, we, gathered data 
' on the degree of differentiation and the occurrence of act.v- 
" itie. which the developer prescribed as part of the mediat- 

ing learning process. 

The Observer used this instruct at the beginning and 
end "of each classroom visit. The initial scoring was not tak^ 

■ en until the- period of science activities had progressed for 
'■ • .t least seven minutes. The observer recorded the number of 

■ students in the class. and how they were distributed across 
grouping patterns: working alone, in pairs, in small groups 

_ „_ 6 , tud .nt.». and in larger groups. Using the matrix, the 
# coder also classified each of the students as to the kind of 
activity the student was engaged in as well as the grouping 

■ arrangement in which he/she was working. Activity scores dis- 
tinguished reading/writing, manipulating .materials without 
talking, talking/discussin, 1 , mixed manipulation of mater- 
ials and talking, thihking/ob.erving/listening, other academ- 

■ ic ^rkfcISin^pTw.naefing/pl.ying, in transition on 
business, in transition not on business, or waiting for the 
teacher: The observer also noted the number of learning cen- 

^ . t . r . posted and in use during the class, noting the names of 
the centers. ( 

This instrument took approximately five minute, to com- 
-# plete. Reliability was ...ess.* i» two phases and with the 
procedure, a. the. de.cribed above. Table ♦ shows the 

O ■ ' . - • 
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• results of 'the reliability checks f6r this instrument. The . 
percentage of agreement was typically over .90. 

3 

INSERT TABLE 4 ABOUT HERE 

Target Child Observation . In order to measure indi- 
vidual behavior, we selected out two sets of target child- 
ren. One set of target children consisted of a sample .strati- 
fied by language proficiency (Spanish and English). A second 
set of children was selected from each classroom on the ba- 
'sis of the teacher's judgement that they presented difficult- 
teaching problems in math. There was some overlap between 
these two samples; the total set of target children contain- 
ed 101 S's. 

,.The sample of target children stratified by language 
proficiency was observed at the same time the observers gath- 
ered- data on the Whole Class Instrument and the Teacher Be- 
havior instrument. Ttf> observers' visited the classroom to- 
gether for this purpose, with one using the Whole Class and 
Teacher Behavior Instruments, while the other scored each 
target child for three minutes. The second set of target 
children was scored by another observer on another weekly vi 
sit to each classroom with the same standardized instrument. 
(For a details discussion of the purpose of collecting data 
on this second set of children, see Rosenholtz,1981) . 

The purpose of the target child observation was to ob- 
tain timed observation of task-related behavior on selected 
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children. The observer began the scoring period for each 
child by recording the nature of the activity and grouping, 
pattern in which the fihild was operating. If an< aide or 
teacher were directly supervising* the student, this was also 
recorded. For each 30 second interval of a'three minute peri- 
od the observer would record the frequency of task-related 
talk, working alone or together on the curriculum, off-task 
behavior, as well as other behaviors not directly relevant 
to this analysis. (For a detailed manual and a sample scoring 
sheet *,see Appendix A) . In addition to recording selected be- 
haviors, the observer recorded whether the* target of the talk 
was peer or adult and the language the child was using. 

The order in .which the £arget children were scored was 
varied on e&c-H visit. The observer was supplied with a ran- 
domized srder for scoring. This was done so that a child 
*suld not always be observed at the beginning or the end of 
. the period when task disengagement might before common. 

The reliability of this instrument was assessed, in ex- 
actly the same fashion as the above two instruments. The 
agreement statistics are given in Table 5 below. The level 
of reliability on this instrument was also satisfactory. 

*' 

INSERT TABLE 5 ABOUT HERE 

Learning, Outcome Measures. A cbntent^ref erenced test espe- 
cially constructed to measure learning outcomes of this cur 
riculum was 1 used as as 'dependent variable for the analyses 



in this technical report.. In addition we used the California 
Test, .of Basic Skirls, the standardized achievement test used 
in the fall and spring in these California classrooms. 
The initial analysis of learning. outcomes of the^cur- 
riculum revealed that the math sub- test of the standardized 
achievement test was very sensitive to learning on this cur- 
riculum. This was because the' math sub-test contained many 
items which were directly relevant to the content of the cur- 
riculum'. When there were word problems, measurement prob- 
le«,. itrrc.-proble,.. or probieas r^uirin^ppifi, « 
ordinates, the students who had experienced the curriculum 
showed outstanding gains in comparison to children in com- 
parable classrooms in these schools (De Avila, 1981). 

Although we also had individual -measures on language 
proficiency and intellectual development, early analysis 
showed'that the single most powerful control for individual « 
characteristics we could use in the analyses was ths individ- 
ual's pre-test score. Especially on the standardized achieve- 
ment test the individual's test score was- closely related to 
language proficiency, because these tests Jan only be taken 
in English. In contrast, the criterion referenced test was 
given in Spanish or English; it therefore did not relate as 
closely >to language proficiency as did the standardized ach- 
ievement- test.; For this and other reasons, the two tests re- 
lated- to process measures of learning in different ways. We 
therefore decided to retain the two different* measures of 
learning outcome in the analyses that follow. 
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The coritent-referenced test was called the Science 
Minirtest. In the discussion and analysis below the standard 
ized* achievement test is broken down to the Math and Reading 
Sub-testslFor each of these three measures we had a pre and 

a post-test score. N 

• Table 6 gives the average pre and post-test score on 
the above-described measures for each of the nine class- 
rooms. There was important variation in the pre-test scores 
which by no means correlated with the care with which the 
curriculum was implemented. 

INSERT TABLE 6 HERE 



Strategy for Testing Hypotheses * 

Each .hypothesis was tgsdted at the individual and class 
room level. The instruments just described provided 'equival- 
ent measures at each leyel. For example, if we wanted an est 
imate of prescribed learning behaviors at the individual lev 
el f it was possible to look at frequencies for reading, writ 
ing, and talking/working together for* eacl\ target child. If 
we wanted to look at this same variable at the classroom lev 
el, we could use the whole Class Observation Instrument to 
calculate the proportion of all the students' in the, class- 
rpom for each observation who were engaged in reading, writ- 
ing, talking and working together. 



After creating various index scores^ we were .faced 
^ v yith the problem of aggregating -across observations. There, 
was a variable number of observations taken in the different 
classrooms* This was partly a product of problems of miscom- 
munication between the classroom teacher and observer as to 



-when the curriculum would {be in operation and partly a pro- 
duct of the fact that som^teachers^ implemented fewer weeks 
of che curriculum than others. ■ J * 

In addition to the problem of differing numbers of ob- 
seryations, there was the more fundamental issue of whether 
it was legitimate to aggregate across observations. If it 
were the case that there "were more marked differences within 
observations made on the same classroom or child than be- _ 
tveen .observations made on different classrooms or child- 
ren, then it .would not be legitimate to calculate mean val- 
ues of the indices. If the sample of observations were not 
sufficiently large to produce stable estimates then it: would 
be most unwise to aggregate. 

In order < to handle this problem we used a standard sta 
tistical procedure. An analysis of, variance was carried out 
on the observations for each index. If "classroom" proved to 
be a significant source of variance ( or "individual" in .the 
.case of target child data), then we concluded that it was 
permissible to calculate a mean value of observations for 
each index. 

Classroom Hypotheses. After selecting suitable ind-' 

. . icators of the three dimensions described above in the theor 

> . * 
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etical framework, each index was aggregated across time for 
a given classroom. With an N of only nine classrooms, we 
could not carry out. overly, elaborate correlational analyses. 
However, **• classroom, as a unit of analysis, has consider- 
able significance in this study because, as will be seen be- 
low, there was considerable variation in the implementation 
by classroom. Furthermore, the classrooms varied on the 
pre-test scores, so that it was critical^ to control; on. the 
pre-test score while examining the effect of implementation 
on the mean post-test seore. 

' - we use a method of partial correlations to solve these 
.problems.. The effect of the pre-test score (aggregated to 
the classroom level) is partialed out; we examine the part- 
ial correlations of the implementation measure of interest 
■ with the mean post-test score for the classroom. Implementa- 
tion .indicators are examined' one at a time; then we combine 
•dimensions to -see if they behave in an additive fashion, so 
that implementation on two dimensions is more closely relat- 
ed 'to learning than implementation on a single dimension. 

individual Hypotheses. Testing hypotheses at the in- 
dividual level is carried out on the sample of target child- 
ren, where we have detailed behavioral measures of prescrib- 
ed 'learning behavior and productive effort. Working at the 
individual level in an analysis, of this type does not elimin 
,ate the need for significant contextual measures which re- 
flect the effect of being in, a particular classroom. • For ex 
ample a child might /e productively, engaged .in the required 
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learning behavior every time we observed him, but if he were 
in a classroom where^a teacher only got through half the cur- 
riculum, he would not have. the same chance to learn the mat- 
erials on the content-referenced £est as a child who was in 
a classroom where the teacher got through the whole curricu- 
lum. - 

Multiple regression is the basic statistical technique 
at the individual level. Contextual variables such as weeks 
of the cufriculum covered in the' child's classroom or v .he le- 
vel o£ differentiation are fed into the regression with the 
same variable for each child in a particular classroom. Be- 
fore regressions are carried out, the intercorrelations of 
predictor variables are calculated so as to avoid" problems 
of raulticollinearity. 

The data bank provides, us with a number of excellent 
indices of prescribed learning behavior and productive ef- 
fort on the part of individuals. For example we have availa 

ble the observed rate of "off-task engagement" and the a- 

mount of written work on the -worksheets. With an N of ap- 
proximately 100 target children P we cannot use too many pre- 
dictor variables at once. After examining the power of indi 
cators from each of the theoretical dimensions, it is possi- 
ble -to- characterize implementation more economically with 
the indicators we know to be significant predictors and 
which do not show too high a level of intercorrelation with 
other predictors. To test the first' hypothesis on the impor 
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tance of lateral relations, it is possible to focus mainly 
on the.. incidence of children talking and working together.* 



RESULTS 



Overall Assesment of Effectiveness 

In an earlier report to NIE, De Avila described the 
learning gains for the nine classrooms ( Improvin g Cogni- 
tion; A Multi-Cultural Approach ,February,1981) . In this an- 
alysis students in the nine classrooms were cornered to stu- 
dents of the same age and linguistic backgrounds who were at- 
tending the same or similar schools. The control schools"^ 
were also involved with the Bilingual Consortium and had 
special 'aides and categorical aid funds. The comparison 
'showed that -studen'tV^in participating classes showed better 
gains in reading and math, as measured by the CTBS. Stu- 
dents in the curriculum also made larger gains on the CTBS 
in comparison to the fall-spring gains of the norm group for 
the test. 

There were also significant gains on the content-refer 
enced test and in oral language proficiency. This analysis 
demonstrated the power of the curriculum to produce gains, 
not only in the areas where it was originally designed to 
.produce learning, but in other areas as well. The curricu- 
lum appears to provide opportunities for improvinVliteracy 
skills as well as opportunities to practice speaking .Eng- 
lish. Furthermore, the children who had shown lack of x Eng- 

\ 
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iish, proficiency at the beginning of the curriculum,- benefit- 
ed from 'the curriculum experience just as much as children 
who spoke English well. 

The most important result, from the point of view of 
this report, was the analysis of the effect of classroom on 
the learning gains of individual children. In an analysis of 
each learning outcome, classroom remained a significant 
source of variance in learning outcomes. It is clear tha$r, al- 
though we are dealing with a powerful curriculum, there were 
major differences in the outcomes which could be attributed 
to the teacher and/or her level of implementation. 

implementation in the* Nine Classrooms 

This curriculum did not operate under "hothouse condi- 
tions." The original intention was to test its effectiveness 
under realistic organizational conditions where the project 
staff provided two levels of support. Neither level of sup- 
port was beyond the financial reach of a district operating 
under normal conditions. In four of the classrooms the teach- 
er and aide experienced only two days of workshop treatment , 
prior to the beginning of the curriculum. The other five 
teachers had the same treatment just described; in addition 
they had two workshops which focussed, not on implementation 
of the curriculum, but on how the teaser and the aide 
worked together. This was an attempt to increase the recip- 
rocal interdependence of the teacher-aide team. 
* 



These nine teachers were not specialists in science. 
They were volunteers who felt that they would like to learn 
how .to teach science. They also felt strongly that lan- 
guage-minority students should have access to science. Sci- 
ence, at the time of the study, was omitted from th'i ele- 
mentary curriculum for all intents and purposes in these 
classrooms largely made up of Mexican-American .children. 

Variation in Understanding 

The first source of variation in implementation was 

the teacher and aiders understanding of the complex science 

• activities at the multiple learning centers. A large part of 

the workshop was devoted to going through the same activi- 
*' * «> 

ties the children were to experience. However, there was no 

way that teachers -could learn and remember so many different 

activities. It was necessary for each teacher to take the 

time to go over each activity and work it through before 

class. There were individual differences in how easy a task 

this was for the teacher; some were convinced that science 

was a frightening and difficult subject. A few proved to ' 

have a "flair" for science or an interest in the content of 

the activities. There were also individual differences in 

the willingness and motivation of the teachers to^take the 

time to do this preparation. Some of them clearly opted to 

omit the preparation and were -seen trying to figure .out the 

instructions with the students during class time. 
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The aides were also invited to the workshop; they were 
encouraged to learn just as much 'about the nature of the ac- 
tivities as the teacher. However, some of the aides were un- 

9 

able -to, attend the initial workshops. Furthermore, as is 
typical of schools operating in this unstable period of fund- 
ing, there were a number of switches in aide assignment, so 
that some trained aides were lost to the project after they 
were trained. This meant that the teacher had to train her 

* - r 

own aide or assign only routine tasks to the aide which did 
not require an understanding of the activities. For example, 
an aide /might be assigned to supervise activities which had 

/ * 

"potential danger to the students, like heating a raisin in a 

test tijibe. , r 

jike the teachers, some of . the aides acquired a good 
understanding of the activities and were -abl4 to r give excel- 
lent Assistance to -the children. Others were never clear a-> 
bout Lhe nature of the activities and/or were assigned tasks 
in tHe,classroom which were routine and did not require this 

I ' 
understanding. 

The is"sue"of understanding of the teacher and aide of 
bow to do the activities was an important - one. If an adult 
really knew what "was supposed to happen in an activity they 
were able, to provide assistance with only a few key words of 
advice or a well-timed question. If they didn't understand 
the activity, they would have to waste a lot of time puz- 
zling it over with the children and , of ten sending them off 
on false leads, "sometimes the" children would decide-that 
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they could do better on Vheir own without an adult — which 
was; probably an accurate evaluation of the situation. 

Beyond the mechanics of understanding^ what was to be 
done at each learning center/ there was variation in the 
teacher's understanding of the basic purpose of- the activit- 
ies. Several of them thought of the program as a general 
kj.nd of enrichment or motivation for science. They missed 
the point of the underlying structure of- the curriculum 
•which was designed as a systematic approach to the develop- 

* - 

ment of* thinking skills. r This led to their hurrying through 
.the curriculum/ unsystematical'ly omitting activities, . especi- 
ally toward 'the end. 

Another kind -of misunderstanding was the failure to 
grasp the open-ended character of the activities. They 'were 

designed so that children working v at different levels of cog- 

» 

nitive development could do the activities differently and 
still gain something from .them. Furthermore, the very pro- 
cess of working things out for themselves was intended to be 
highly beneficial, 'some of the teachers seemed to feel that 

there was a one best way to do each activity a "right ans- 

-wer" approach. These teachers tried- to -work with children in 
larger groups and ensure that they put the right answer down 
on their worksheets. Thus they attempted to standardize the 
learning experience in a way that was never intended by the 

developer. i 

in general, the origin of these problems was felt to' 

lie in the lack of basic theoretical instruction in tne ini- 

<■'■<. ■ • * 
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tial workshops. We only had enough time to to get them oper- 
itihg 4n sobs practical sense and not snough tims to give 
them a. mors fundamsntal. understanding of the theory behind!'- 
the curriculum. r . . ♦ > 

, ; !."',• , ' .' * - . • 

variation in Curriculum Coverage 

A second issue in variation in implementation lay in 
-how many weeks of the. curriculum were covered, several 
teachers found, themselves at the end of the school year with- 
•out having finished all : 15 weeks of curriculum activity v One 
teacher only covered about six weeeks of the activity. She 
never seemed to find time in the day to^do the curriculum. 
The observer would often go out to the classroom with the un 
•derstanding that the curriculum would be in operation only 
to find out that it would not be taught that day. ThiA hap- 
^pened, with such annoying regularity that the staff began to 
wonder whether this teacher were actually hostile to the pro 
ject. After some discussion with her and further "observe- 
tioh of her classroom, we decided that she had fundamental 
•problems in^organizing her schedule and problems with manag- 
in'g the curriculum? Since she was unwilling to delegate au- 
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thority, she only used a fe^w centers at a time from the 
beginning.. By the end, she had resorted to whole class in- 
..•truction delegating authority to a few" favorite students to 
help her* supervise. In contrast, other teachers meticulously 
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.nd enthusiastically went through all 15 weeks of the curri- 
culum. 

Table 7 presents the number of weeks of the curriculum 
completed by. each of the nine teachers. It should be noted 
that the concept -week-- of. the curriculum did not turn out 
to be necessarily' the same as a calendar week, in construct- 
ing the curriculum, the learning centers were grouped by cur- 
riculum topic. We packaged activities and delivered them, 
defining a week's activities in terms of the recommended num- 
ber of learning centers a child was to complete under a giv- 
en curriculum topic. A curriculum week required twelve 
learning centers a week in the' first part of the curriculum, 
-but was reduced to six after Christmas, individual teachers 
sometimes took more than a calendar week to- get through a 

r • 

curriculum week. - 
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vayiafcion in Staffing 



A third issue in variation lay in changes in the teach- 
ing staff. In two classrooms, teachers left the school be- 
cause of .pregnancy. We had to train their- replacement on an 
individual basis- When teachers were absent, the plight of a 
substitute who came in unprepared to deal with such a com- 
plex curriculum was often pitiable to observe. 
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Variation in Recommended Teaching Behaviors 



He had specifically asked teachers to engage in behav- 
iors which were new and different: in the workshop we had ad 
vised them .to observe which children were not working at the 
activities at the cognitive level of which they were capa- 
ble. We advised them to try to extend the activities for 
such children by asking questions. We actually provided them 
with questions' in connection with each learning center which 
would provoke further inquiry by the ^children. 

We also stressed to the teachers the importance of giv 
ing students specific feedback on their worksheets. However, 
as one might imagine, the teachers were just able to keep 
H their heads* £bove the water" with facilitating all these 
new activities every week. Because the understanding,, and' 
facilitating of the mechanics of the learning centers was a 
challenge of such great difficulty for most of them, they 
hardly , seemed to have time' to practice the" recommended teach 
ing behaviors, at least on this first attempt to teach the 
curriculum.' , « 

The systematic observations of teacher behavior re- 

vealed the failure of most of the teachers to practice the 

* **** 

specific recommended behaviors. On the Teacher Behavioj: in- 
strument <we counted the number of instances of teacher ex- . 
plaining, questioning and/or extending activities. These be- 
haviors were totaled for each 15 minute period of observa- 
tion and were called "teacher instruction" in the analysis. 

<» 
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i We also counted the extent of feedback, which was defined as- 
instances of discussion of specific strengths or weaknesses 
concerning either the students' (individual or group) per- 
formance on previous worksheets, the current worksheet, 
skills, general progress, or working together. For each 
type of teacher behavior, the total frequency, was divided by 
the number of observations of that teacher so as to yield an 
average frequency , per IS minute period.Table 8 gives the re- 
sults of this calculation for. each teacher. For each type 
of instruction the average frequency and the standard devia- 
tion are included/The data are further divided by whether 
the teacher behavior was directed to individuals or to 

O groups. 
- Apparently the teachers did not adopt the suggested 
Voles. Even with a liberal definition of instruction (which 
' included explaining), no teacher had an average rate of 

greater than 2.1 per 15 minute period of instruction to indi- 
viduals, instruction to groups was not that much more com- 
.mon. Fouf of the nine teachers had an average rate of less 
"* than one -instruct- to individuals per observation. The 

mean value for instruction for all teachers was 1.14: to indi 
viduals and 1.52 to groups. 

Feedback varied between a- low of 1.32 to individuals 
' „ for one teacher to 5.90 for -another teacher. The average 
rate of feedback to Individuals for all teachers was 4.32; 
the mean rate to groups was 1.11. 
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Because of the low level of recommended behaviors on 
the part of teachers; we did not. feel it was necessary to in- 
clude the frequency of teacher behavior in relating implemen- 
tation to learning outcome^ 1 It is of course very interest- 
ing- that, the learning gains observed 4 in this curriculum evi- 
dently did not. require high levels of these teacher behave 
iors; We cannot tell what would have been the case if the 
teachers had done as* we instructed. The learning outcomes 
ght have been even stronger. In any case, this curriculum 



mi 



does not seem unusually dependent on the teacher managing 
all aspects of the recommended role shift. , 



Variation in Differentiation 

In addition to these obviously important^ ways in which 
classrooms "differed, implementation varied along the three 
dimensions conceptualized in the theoretical framework. 
We shall examine- this variation in terms of the observation 
measures'* in the following sections. 

' Teachers clearly varied in the differentiation of the 
curriculum as measured by the number of different learning centers 
we -found in use when observers visited the classroom. The first 
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TABLE 8 



Frequency of Expected Teacfier. Implementation Behavior 
To individuals and. Groups in the Class 



(Mean Scores and Standard Deviations) 

INCIDENCE OF 
INSTRUCTION 



INCIDENCE OF 

FEEDBACK 
TO STUDENTS 



Teacher 
Number ^ 



1 4 To Individuals 

To Groups 

2 To Individuals 
To Groups 

3 To Individuals 
To Groups 

4 To Individuals 
To- Groups 

5 To Individuals 
To Groups 

6 • To Individuals 

To Groups 

7 To Individuals 
To Groups ^ 

8 - to, -Individuals 

To Groups * 

9 to Individuals 
4 To .Groups 

Total population 

To Individuals 
To Groups 



NO. of 
OBSERVA- 
TIONS 



Mean 


sd 

* 


Mean 


sd 


n 


.4 

2.1 ■ 


1.14 . 
1.96 


2.30 
..50 


3.69 
1.41 


8 


0.0 
1.0 


O.OO 
1.65 . ' 


4.80 ' 
.06 


6.08 
.25 


16 


0.6 
1.4 


1.02 
1.86 


,'1.90 
.28 


2.39 
. .70 


15 


.1.7" 
1.4 


1.45 r 

3.00 


1.50 
.41 


2. 55 
1.70 


17 


1.8 
2.1 


1.5.6 
3.31 


1.00 
.06 


1. 32 
.24 


1 / 


1.7 
.7 


1.86 
1.49 


« 2.00 
.36 


2.32 
1.21 


li" 


2.1 
_1.0 

* 


1.47 
1.32 


, 3.40' 
.12 


3.98 " 
.31 


10 


.6 
2.2 


1.90 
3.25 


4.80 
1.00 • 


6.35 
1.56 


10 


1.1 , 
2-4 


1.53 
1.94 - 

J 


5.90 
.78 ' 


6.81 
1.64 


9 


1.14 
1.52 


1.52 
2.39 


'2.86 
.35 


4.32 . 
1.11* 





week most of them started out with all the learning centers 
in action as they had been instructed. By the second week 
each one "had reduced this number, but some far more than 
others. Even after Christmas, when we reduced the 
recommended number of learning centers to six, few class- 
rooms implemented this recommendation literally. 

There was a characteristic level of differentiation in 
each classroom which developed after the first week. An anal- 
ysis of variance of the second through the, last week of ob- 
servations showed classsroom to be a significant source of 
variance in the number of learning centers in use (F = 8.06; 
p<.001). In other words, there was more variation .between 
observations made on different classrooms than within ob- 
servations made on the same classroom. 

Table- 9 shows the average number of learning centers 
in use. in the nine classrooms starting with the second week 
of observation. Teacher #8, \:ho finished the. fewest weeks 
of the curriculum, had only 2.3 learning centers in use a- . 
cross observations, while Teacher #9, who completed the cur- 
; riculum, had 6.9 learning centers in. use, on the average. 
Teacher. #1, who also completed the curriculum, only had an 
average of 4.1 learning centers in use. This teacher tended 
to use fewer centers at a tima and to supervise larger 
groups in a direct manner. In order to complete the curricu- 
lum in this way, she gave it much more classroom time than 

any other teacher. 

The issue of differentiation was closely linked to the 
issue' of delegation of .authority. Using more learning 



I 



centers at once, necessitated more delegation of authority 

to students. There were critical differences in the way the 

teacher played her role. . h « 

Some teachers tried to maintain a traditional role of 
giving direct instruction to larger groups, restricting the 
number of learning centers that could operate at once. Such 
a teacher would assign aides (sometimes two in a classroom) 
to cover the groups she could not personally supervise. Oth- 

> 

er teachers allowed the children to move from center to cent- ^ 
er on their own. The students had to take the responsibility 
for deciding when they were through with a given learning 
'center and the responsibility for getting themselves through 
each .center available for the week. The teacher would rapid- 
ly move about the classroom facilitating activities. She 
would focus in particular on children who appeared , to be con- 
fused or wandering about. She would spot difficulties with 
the activities and try to "trouble shoot." 

As constant visitors to these classrooms, we saw this 
variation in deSegation to authority. The phenomenon had con- 
. sequences for the observed number of learning centers in use 
and for the frequency of large student groups. Teachers whom 
we observed as trying to maintain routine bureaucratic super- 
vision, actually had fewer learning centers in use and more - 
frequently used large group instruction. This particular prob- 
lem of the changed role for teachers required 'by a particular 
curriculum is one what has been described by Fullan as the 
most common problem in implementation (4.980). - 
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* INSERT TABLE 9 HERE 
Variation in "Productivity 

c « 

As- a measure of productivity at the classroom level, we 
used the average number of worksheets completed by a child in 
the class over the course of the curriculum. Most of the act- 
ivities required the student to fill, out a worksheet in Eng- 
lish or Spanish. 

We asked the teacher to save these worksheets for pro- 
ject data. At the end; of the curriculum, we collected them, 
and counted the number for each child and classroom. It 
should be noted that this is a good measure of productivity 1 
on the classroom level. Those classrooms with fewer numbers 
of worksheets were thbse classrooms completing fewer weeks of 
the curricula as well as those classrooms where teachers did 
not place much stress on completion of worksheets. 

Teachers" did vary in how much stress they put on the 
completion of worksheets. Some would demand a satisfactorily 
completed worksheet as a "ticket" to- the next learning "cent- 
er. Others did not even have a systematic way of collecting 

» 

or checking over worksheets. For still others, filling out 
worksheets became a supervised group activity instead of an 
individual activity where the" student had major responsibili- 
ty. 
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Returning to the classroom level, analysis of the num- 
ber of worksheets per child por week revealed that classroom 
was a significant source of variance. This means that there 
was ^characteristic level of worksheet productivity pertain- 
ing to the. different classroom*. Table 9 gives the average 
figure for^each of tfife r ~nine classrooms. 

There was a maximum of 160, worksheets provided to class- 
rooms for each child to fill out. Not surprisingly, no class- 
room showed that level" of productivity; some student were ab- 
sent or much slower in completing activities than others, 
even if they were given access to all these worksheets. The 
variation in productivity was oven greater than the degree of 
variation on the measure of differentiation. 

Variation in Medi *<-<"q Learning Behaviors 

Table 9 also shows the percentage of children who were 
observed reading, writing, talking, and manipulating the mat- 
erials. These measures come from the Whole Class Instrument. 
• it will be recalled that this instrument classifies each 
child as to type of activity. ?s was administered twice for 
every classroom visit. If «u were apparently working at 

learning centers, it was ms** .*. that talking was task-rela- 
ted. It was not always easy to assess this with great cer- 
tainty. 

in order to construct the index of "average percentage 
of all children doing each activity for a classroom," the ba 

°\ , — — "' - 
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sic figure of an average percentage across all observations 
in a given classroom was weighted by the. average number of 
children present in that classroom. This was done by dividing 
the average' percentage in a given activity by the average num- 
ber of students present over all observations in the class- 
room. This was then divided by the grand total of Ss involved 
in all activity modes, across all observations. 

Analyses of variance ^were conducted on the percentage 
reading/writing and~-th"e*percentage talking, week by week. 
These\were the major categories used in the analysis. Class- 
room proved to be a significant source of variance for both 
these variables; for percentage reading, F -2.22, p < .05; 
for percentage talking, F « 3.79, p < .001. Jn other words, 
there were leVels of these activities which tended to be char- 
acteristic of the instruction of a given classroom. It was 
therefore legitimate to aggregate data across observations 
for each classroom. 

Overall, the 'behavioral variables reveal that many 
classrooms were a ferment of activity stemming from the curri- 
culum. This corresponds with the observation of any visitor 
or staff observer in these classrooms. Larg£ proportions of 
the children were talking, manipulating, reading the in- 
structions, or writing on the worksheets. Particular class- 
rooms varied, both in the total proportions of children so en- 
gaged, and in the average percentage of children showing dif- 
ferent learning behaviors. For example, teacher #9, who had 
such high levels- of produccivity , also had a high proportion 
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of the students engaged in recommended learning behav- 
iors(73%); and a high degree of differentiation as well. At 
the other end of the spectrum, teacher #8, who had th~ low- 
est level of productivity and differentiation, also had the 
second lowest percentage of students engaged in the mediating 
learning process — only 51% of her students, on the average, 
were seen engaged in the recommended behaviors. 

Teacher #6, however, who had low productivity, had a 
high ^proportion of students engaged in recommended learning 
behaviors (73%); she showed a middling level of differentia- 
tion. Some classrooms were much more likely than 
others to have children talking. Three classrooms had approx- 
imately eleven to twelve percent of the children, on the av- 
erage, reading and writing, contrasting with three class- 
rooms where an average of only four percent and six percent 
of the children were seen reading and writing. 

i 

Hypothesis on Lateral Relations 

The first hypothesis, it will be recalled, predicted a 
positive relationship ^between the frequency of lateral re- 
lations auiong, students and the amount of learning. This rela- 
tionship should hold under conditions of a high level of dif- 
ferentiation in the technology. Lateral relations between 
children represent a delegation of authority from the teach- 
er, which . according to sociologists who have studied technol- 
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ogy and work arrangements* should take care of the problems 
. arising from a high level of differentiation. 

Table 9 illustrated' .the 'fact that in all the class- 

« 

rooms we saw a relatively high level of differentiation* 
Rosenholtz examined the level of complexity of the technol- 
ogy observed during the curriculum and compared it to the 
complexity of the regular math periods. He found 5 relatively 
few of our curricular sessions which employed whole class 
instruction. These "typically took place when the teacher was 
trying to, orient the whole class to a new batch of, learning 
centers. Rosenholtz found only 13 of the FO/D observations 
which fell into-, his "Low Complexity" category ( 1981). We 
can therefore test the relationship in* the .hypothesis, -using 

0 

all the FO % /D observations/ under the general assumption that 

> 

the curriculum did indeed represent a high level of actual 
differentiation in the classrooms* 

The hypothesis concerning lateral relations can'? be 
tested at the* classroom and' at the individual levelK Table 9 
gives the average percentage of children- observed "talking 
and discussing with others for each classroom. This percent- 
age ranged from '5* for -Teacher #8 to 18% for -Teacher #9, 

In testing this hypothesis it is . esssential to hold 
constant the average pre-test score on the learning measures 
for -a given classroom* Table 6 showed the marked variation 
in the averagef values' per classroom for these measures* 
There was the additional difficulty that in some of , the 
classrooms with weaker, implementation/ the pre-test scores . 
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were higher. Therefore, -we partial out the'ayerage pre-test 
score and compute a partial correlation between the percent- 
age talking and discussing and the mean post-test score. 
The N for this calculation is only nine., because the uni£^of 
analysis is the classroom. 

The partial correlations of the percentage of the 
class observed talking or discussing with others with CTBS 
Math (the Total'score and the Application Subscale) and with 
the content-Referenced Science Test are as fellows: • 

CTBS Math Total '■ .13; , 

CTBS Math' Application Subscale .21; 

Content-Referenced Science Test ; .64. 

• ; 

The partial correlation between -talking and the Science Test 
is statistically significant .at beyond the .05 level. This 
means that classrooms where* a larger percentage of students 
were engaged in horizontal communication were classrooms 
which. showed I :rger gains on the science test. 

let "us turn now to the individual .level and see if the 
relationship observed* *t the classroom level also holds for 
the sample -of target children. Task.-related talk to peers 
was a specific category in the Target Child Instrument. Ana- 
lysis of variance showed a certain stability in the individu- 
al's child's rate of talking across observations; (F-1.39;- 
p < ;oo9). 
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The Target Child Instrument also contained a 'category 

called "Works Together with Others. " Every time the observer 

M - ■ ' • - 

saw this occur , s/he made a check on the scoring sheet. As 

»*"%*- 

with the rate of talking, child was a significant source of 
variance in the frequency of this behavior. per observation; 
F«1.28;p<.033) . • - 

The "frequency of .interdependent relations in the con- 
text of the curriculum * was very high. Overall the target 
child worked with another child Y an average of twice in a 
three minute* period. Table 10 gives the average rates of 
these behaviors for target phi ldten in the classrooms of 
each of tW nine teachers. * 
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INSERT TABLE 10 HERE 



Although interdependent work relations were common in 
all the classrooms, it is interesting to see that the lowest 
average rates occur in Teacher #1, #2, and #4/ s -classroom. 
Both Teacher #1 and #2 had two aides and tried to use direct 
supervision wherever they could. As a result they cut down 
on the lateral relations between children. 

The best measure of lateral relations between children 
is one which simultaneously takes into account task-related 

talk and working together. We created a special variable, 

> • & 

called Talking and Working Together to capture the concept 
of lateral relations. This was done by multiplying the rate 
of student task talk per observation by the rate of observed 
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working together 'per observation. The unit of, "task talk" 
was defined as an uninterrupted speech with the same part- 
ner. The total frequency 'of these speeches for all three min- 
ute observations was divided by the number of observations 
.for that child. This average rate of talking was then multi- 
plied by the average number of times we scored "working toge- 
ther" for the sime child. 

Table 11 presents the partial correlations of this var- 
iable with the Math achievement test total and the con- 

* • ; - « 

tent-referenced science test scores. As in previous analy- 
ses, the pre'-test score is partiaied out. In addition to the 
Talking and Working Together Index, Table 11 presents the 
partial correlations for the two parts of this index . -par- 
ately: Talking alone and Working Together frequencies. Also 
included is the variable of Talking and Manipulating. This 
was" scored when th* target child was simultaneously talking 
about the task and handling the equipment at the learning 
center. 

INSERT TABLE 11 HERE 

The best measure of lateral relations, Talking and • 
Working Together, has a significant partial correlation with 
the Science Mini-Test, .26, which is statistically signifi- 
cant beyond the .01 level. The simple rate of task r related 
talk bears a significant relationship to the overall math 
score, but the relationship to the science test is not sta- 
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tistically significant. Instead, the simple frequency -of 
working together*' predicts the science test gains, but not 
the gains in the iftath N test* Manipulating and Talking is sig- 
nifican.tly related to both test measures. 

Overall,' there is a strong relationship between these 
measures of communication and interdependence and test score 
gains. -The target child measures show that: for tlfese child- 
ten and with these more detailed measures, lateral relations 

are helpful for learning pn the standardized achievement 
* ~~ 
test as well as for the science test. In general, ~ the re- 
suits for the target child level parallel the results at "the 
classroom level? lateral relations have the most signifi- 
cance for the content-referenced test, but some significance 
for the math test, as",well. The first hypothesis has re- 
ceived support at the classroom and at the individual level 
of analysis. The signficance of this statement lies in the 
completely independent nature of these two sets of observa- 
tions. 

Learning as as. Function of Implementation 

■» * * 

r We are now ready to * turn to the test of the second hy- 
pothesis concerning the 5 relationship between implementation 
and learning outcomes, using the three dimensions of imple- 
mentation selected as having theoretical importance. Again, 
these rich data allow us to test this hypothesis at the 
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classroom and at the individual level. First., we test,. the hy- 



pothesis at the classroom level of analysis. 

\ 

\ 

implementation and LearningtClassroom Level 



There 'are, in this analysis, three dimensions- of imple- 
mentation: Productivity, Differentiation., and Mediating 
Learning Process. Productivity is measured by the average * 
number- of worksheets per child in a classroom. Differentia- 
tion is measured by the average number .of learning centers 
in use per observation in each classroom.' The'\aribus dimens- 
ions of learning behavior, are measured as described above, 
by the average proportion of students in the classroom who 
were seen engaged in prescribed learning behaviors. 

Table 12 presents -the zero order correlations among 
all implementation and outcome measures. The reader should 
keep in mind that relationships of implementation variables 
to outcome measures are -affected by. the pre-test 
scores (which are uncontrolled" in this analysis ), and by the' 
small sample of 9 classrooms, on which the correlations are 
computed. Also included in this table are several combina- 
tions of prescribed learning behavior and productivity : 
Reading/Writing & Worksheets; and Talk & Worksheets. These 
intercorrelations permit us to examine how well the three di- 
mensions, are related to each other. We can also see if all 
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the prescribed learning behaviors work in pretty much the 

**** ' 

sane way in relating to productivity and differentiation. 

The first thing to notice about Table 12 is the low "le- 
>■ vel of relationship between the measure of differentiation 
and productivity ( r ■ .07 ) ; these are independent dimen- 
sions. On the whole, there are modest positive correlations 
between productivity , ' differentiation, and the prescribed 
learning behaviors with one striking exception. The propor- 
tion of children manipulating the materials is negatively re- 
lated to every other 'behavior (with the exception of talk- 
irig); manipulation is also ^negatively related to productivi- 
ty and differentiation. This- finding was totally unexpected. 

There are significant zero-order correlations between , 
the number of worksheets and the post-test scores on the 
CTBS. This would suggest that those teachers who covered 
• more of the curriculum, placing the recommended emphasis oh 
worksheets, had better- results than those teachers who either 
omitted weeks of the curriculum or did not demand that the 
children complete their worksheets. The same is, not true for 
. the measure of differentiation.. Of the various learning be- 
haviors, reading/writing show significant positive correla- 
tions with CTBS math scores. Manipulation is significantly 
negatively related with all learning outcome measures. 

The relationship of implementation to learning out- 
comes is quite different for the content- referenced science 
test than for the CTBS math test. For the science test, the 
only significant zero order correlation with implementation 
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is a negative relationship with 'percentage' of students manip- 
ulating materials,. There are other .puzzling negative rela- 
tionships between this test and the- measures, of lmplementa- 
tionl B6th the level of differentiation and the percentage 
of students reading/writing are negatively associated with m 
post-test science outcomes'. On the overall measure of imple-< 
mentation there is only a correlation of .10 with the sci- 
ence t^est v * 

In contrast , t for the CTBS math test; the correlation 
with the combined implementation index is .67, significant 
at the .05 level. The only strange relationship .for this 
standardized 'test of achievement* is with the' percentage of 
students in the class manipulating materials a negative re- 
lationship. * 

The two teachers with the ; weakest ^overall implementa- 
tion happened to have the highest average pre-test scores. 
The correlation between the measure r of differentiation and 
the pre-test was therefore -.52.* The correlation between 

the proportion reading/writing 'and the .pre-test score was 

* * * 

-,19. Thus, Kit becomes critical!to partial ^out the effects 

of the pre-test score in examining the ; impact of implementa- 
tion on learning, especially •> oh the science test. 

It can also be argued that it is' essential to partial 
out the effects of the pre-test scores on the CTBS. The 
strong observed correlations between percentage read- 
ing/writing and average number of worksheets and CTBS math 
could be an artifact of classes who know how to read and 
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write comparatively weil and are therefore found filling out 
their- worksheets and gaining higher scores, not because of 
the curriculum, but because they are more advanced academ- 
ically in the first place-. 

In' review, Table 12 demonstrates at* least -four points. 
First, it indicates that the dimensions" of implementation 
are relatively' independent of each other. Second, there are 
. strong zero-order correlations betwen the CTBS math- and the 
measures of productivity and reading/writing. Third, "the per- 
centage of students involved in manipulation of materials 
has quite a different relationship to other mediating learn- 
ing variables and to< outcome variables than was expected by 
the developer. This is why the combined index of implemen- 
tation omits this' variable for the time Joeing. Fourth, of 
all the implementation variables, productivity is the most 
powerful predictor of learning outcomes. Producing more work- 
sheets is associated with higher average scores on CTBS 
math. 

TABLE 12 HERE- ~ 
Table 13 compares- the relative strength o£. the differ- 
ent dimensions of , implementation in predicting the average 
post-tests score for the classroom, partialing out the effect 
of the average pre-test score. The relationship of product ivi 

' V 

ty to the CTES math test holds, although it is no longer sta- 
tistically significant, once the pre-test score is con- 
trolled. The relationship of productivity to the science test 
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is now postive C.31 1 ), once the effects of the relation- ship 
or productivity .to the pre-test score is 'partialed out.. 

Differentiation has a modest positive relationship to 
all learning outcome measures in this analysis. As for the be- 

A * 

o 

havioral variables, the strongest predictor of the math CTBS 
score is still the proportion reading/writing (r » .57T. 
This behavior bears no relationship to the science test. In 
contrast, the percentage of the class observed talking shows 
a- statistically signiricant relationship to the science test 
(r » .64). Manipulation continues,, to show negative relation- 
ships to the learning measures. - , . 

INSERT TABLE 13- HERE 



The second section of the table takes two dimensions of im- 
piemen tat ion at a time to see if this increases the power to 
predict learning outcomes. When worksheets and reading/writing 
are comb'ned as a single index, there is a statistically signif- 
icant relationship to the average CTBS math scores. If talking is 
combined with worksheets, ability to' predict math scores falls 

somewhat from that of productivity alone. The combination of pro- 

* . , ' . 

ductivity and differentiation gives a stronger coefficient for - 

each of "the learning outcome measures than that yielded by each \ 

\ 

of these dimensions individually. \ 

When three dimensions are combined into an index, or when 
all variables are combined, the power to predict learning outcomes 
remains high for the CTBS, but not as high as the percentage talk- 
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ing', by iteslf, in predicting, the content referenced test* 

Qiscussion of these results will be postponed until after 
the hypotheses on implementation are repeated for the .individual 
levelT However, it is valuable to review the results that should 
be compared to the findings on the individual level. Productivity, 
as measured by the average mimber of worksheets per child in a 
classroom has. powerful relationships to learning outcomes. Ob- 
served reading and writing seems to be more powerfully connect- 
ted to the standardized math scores than to the science minir 

r 

.test. The percentage talking is the most powerful predictor of 
the science mini-test. 

The 4 three dimensions of implementation are not correlated 

i ' > 

at the classroom level* Differentiation only has a modest pos- 
itive relationship to learning outcomes. It does have the ef- 
ec^of boosting the power of productivity (worksheets) to predict 
all learning measures* Similarly , one can boost the power of pro- 
ductivity to predict math gains with the proportion reading/ 
writing, but productivity combined with proportion talking is in- 
ferior to the simple proportion talking in predicting science test 
gains. . ' 
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Implementation and Learning; Individual Level 

r 

At the individual level the data are taken from^ the 
target children, whom we observed weekly for three minute in- 
tervals. These data on- the behavior of individuals are com- 
fcined with a contextual variable representing the instruct- 
ional ^organization of the classroom. One cannot analyze da- 
ta on children as if they were operating in a vacuum; their 
behavior will be very much affected by the task organization 

of their classroom. 

' \ " ^ 

Effect of Productivity and Classroom Differentiation. ' 
The best measure o% productivity at the individual level is 
the child's engagement with the task. This is also a concept 
which has the advaritage of wide use in contemporary class- 
room resea-relH— In— the" Target Child Instrument, every time 

^ 

the child was clearly w off-task, M the observer made a check 
mark. The definition of w off-task M in the context of this 
curriculum odid not include behaviors such as watching others 
or behavior that might indicate thinking about ^ the task. The 
whole concept of disengagement, it seemed to us, was rela- 
tive to the demands of the task. A rigid definition of en- 
gagement such as "eyes front,", or working with instruction- 
al materials, seemed quite inappropriate for this situation. 
If the child were moving about or engaged playfully with 
classmates, did the observer check "of f -task. " 
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In developing a rate for "off-task* behavior, we ^count- 
ed the proportion of all recorded behaviors that were in the 
"off-task" category. We chose to do this rather than a 
straight frequency count because of 'the characcer of the 
scoring system. If a child rapidly alternated between being 
on and off 'task, s/he might acumulate more "off-task" scores 
than a child who was continually off-task for the observa- 
tion ,period. By creating an index of the proportion of 'all 
behaviors which were "off-task," we could derive a rate for 
"off -task" behavior for the "chree-minute period. Translating 
the proportion into a "rate" assumes .that each recorded beha- 
.vior took approximately the same number of seconds. 

• In order to calculate a rate of "off-task" behavior 
across observations for a particular child, we carried out 
an analysis of variance to find out if there were rates 
which were characteristic of particular children over the 
weeks of observation. The child* proved to be a significant 
source of variance in thd observed rates (F 38 !,. 68 ;p< .-001 ) . It 
was then legitimate to create a mean "off-task" behavior' 
rate for each target child" by adding the rates for each ob- 
servation and dividing by the total number of observations. 
In the following discussion of results, we shall call this 
statistic the mean rate of disengagement. It should, of 
course, have a negative relationship to learning. 

The frequency distribution of rates of disengagement 
for the target children was skewed toward the low end of dis- 
engagement. Table 14 groups this distribution into six inter- 



vals- based on natural breaking points in the, frequency dis- 
tribution. This curriculum was obviously a highly -engaging 
one. Fully 19% of the target children were never seen disen- 
gaged in all the weeks of observation. Forty-eight per cent 
were disengaged less than 11% of the time. Only 6% ware dis- 
engaged, on the average; for more than a third of th» time. 

This finding is especially significant in vie* of the 
fact that the sample of target children included those seen 
as especially problematic by their teachers and children who 
had little proficiency in English ^pr Spanish . „ 
From a statistical point, of view the fact that this is not a 
normal distribution is undesirable for regression analysis. 
However, in accord with common practice in the field, we de- 
cided to use it anyway, keeping in mind the limitations of 
the measure and relying on examination, of other measures of 
productivity to back up any results with this particular be- 
havioral indicator. 

V 

INSERT TABLE l4 HERE 



In designing a°regressipn equatiqn to test t^'e impact 
of disengagement on learning, the measure of differentiation 
at the classroom level was inserted as a contextual 
variable. The classroom measure of the average number of 
learning centers in use was utilized as the measure of dif- 
ferentiation. Clearly an individuals level of engagement 
must be partly a function of the range of options of tasks 
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s/he might be carrying out; in this case the number of use- 
able learning centers,, is a good representation of the organi- 
zation of- the classroom. Each chi'ld in a classroom was as- 
signed- the same value of the differentiation .variable. 

The average number of learning centers in use in a 
classroom is negatively correlated with a child's rate of 
disengagement (r « -,22;p<.05) .• This correlation along twith . 
all the mother zero order correlations of the implementation 
and outcome measures at the individual level may be seen in 
Table 15. Unlike the classroom level ana ( lysi this, analysis 
♦finds a positive relationship between the two dimensions of 
productivity and differentiation. There are several good > 
reasons why this might be the case. In the first place, the 
behavioral measure is much closer in time to the learning 
center usage than the worksheet measure used at the class- 
room 'level. When there are more learning centers in use, a' 
child literally has more things available to do to keep him- 
self busy. In the secdnd place, more learning centers in use 
' means that there are more small groups scattered about the 
classroom. Small groups has repeatedly been found to produce 
high levels of engagement in previous research (Berliner et 
al,1978; Hess & Takanishi-Knowles,1973; Ahmad jian, 1980 ) 

Although the observed level of association is not very 
high, the problem of multicollinearity must be kept in mind 
when examining regression results. We chose to use step-wise 
regressions on the learning outcome measures. The pre-test 
scores were stepped in first, followed by the contextual var 
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iable of number of learning centers in use. The measure of ^ 
productivity* Was. stepped in- last even though the problem of 
multicollinearity put it at some' -disadvantage" in competi- 
tion with differentiation and in competition with the 

> 

pre-test score on CTBS Reading. .Table 15 shows, that there is 
also a significant negative correlation between disengage- 
ment and the pre-test score on the reading test. Poor read- 
ers are rather notorious in classrooms for their level of 
disengagement. * 

INSERT TABLE 15 HERE 

The order of -the predictors in the regression was dic- 
tated by theoretical considerations. It seemed to Us that 
the impact df individual disengagement should be examined in 
light of the contextual situation as well as in light of the 
'individual's starting,, point on the test score. We -have in- 
cluded the summary of R 2 for each-regression equation with 
the first, second, and third predictor variables -stepped- in. 
Learning" outcome measures for>the individual level* 
• analysis included the total score On the -standardized read- 
ing test as well as the math test(CTBS). Since preliminary 
analysis of learning outcomes showed strong gains in reading.^ 
for the children who experienced the curriculum, it was of 
especial interest to link- these, gains with behavioral mea- 
. sures of implementation. The third measure of- learning was 
the content-referenced test, called the Science Mini-Test. ' 
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All three measures show very high intercorrelations at the 
two points in time. Even the Science Mini-test is highly cor- 
related with the reading test, despite the fact that the Sci- 
ence Mini-test was read out loud to the children in English 
and Spanish. These intercorrelations may be seen in Table 
15. The very high level eff" correlation, especially for the 
reading test, between scores taken at two points in time, 
means that the - implementation measures must make a contribu- 
tion to explaining the- variance, over and above the large 
amount of. variance that; is accounted for by the individual's 
pre-test score. 

Table 16 gives the results of the regression ^equations 
on disengagement and differentiation. Despite the unfavora- 
ble position of disengagement with respect to the order of 
the predictors in the regression, disengagement is negative- 
ly related to learning outcomes for all three measures. It 
produces beta weights with statistically significant E val- 
ues. Of course the amount of variance it accounts for in 
the learning measures is very small in comparison to the -im- 
pact of ..the individual's pre-test score. -The reading 
pre-test score accounts f or \71% of the variance in the 

post-test score a "lion's share" of the variance. 

Disengagement can only account for 1% of the variance in ad- 
dition to what has already been acounted for by' the pre-test 
score and the number of learning centers in use. Disengage- 
ment accounts for 6% of the variance, uniquely, in the equa- 
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tion on the math test, and 2% of variance *on the Science 
Mini-test. 



INSERT TABLE 16 HERE 

Differentiation is not, by itself, a significant pre- 
dictor of gains on the Science Mini-Test. This is parallel 
to the finding at the whole class level. Differentiation, 
does, however, have a statistically significant beta weight 
in the equation for the reading test. Finally, it should be 
noted that in the case of each measure of learning, entering 
the value of both the productivity and differentiation mea- 
sure accounts for more variance than differentiation alone. 

Effe ct of Learning Behaviors; Individual Level . At 
the individual level the two most relevant behaviors to exam- 
ine are the frequency of reading or writing and the rate of 
talking and working together. These are the variables which 
appeared to be important at the classroom level. From a the- 
oretical point of view, we already know that working/ togeth- 
er and talking are important from the analysis of the -impact 
of lateral relations on learning. The significance of ob- 
served practice in reading 1 and writing as a predictor of 
gains on standardized achievement tests is particularly 
great because of the fact that this -practice" took place in 
a functional context of the child solving a problem. It did 
not take place in the context of the reading group or other 
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drill* recitation or seatwork exercises, so common in to- 
day's classrooms. 

The index of reading/writing was a simple frequency 
count taken for each target child observation. On the front 
of the scoring sheet the observer checked off whether or not 
the child was seen reading or writing at any time during the 
three minute observation. Thus the score could only be zero 

or one for each observation. The total frequency was divided 

• - 

by the number of observations to yield an average number of 
times the child was seen readijvg or writing. 

The index of talking/working together Was described, in 
the section on lateral relations. It is simply the product 
of the rate of talking about the task and the rate of work- 
ing with peers averaged across^ observations. 

The intercorrelations of all the variables used in the 
next set of regression equations are shown in Table -15. Note 
that the two behavioral measures of reading/ writing and 
talking/working' together are unrelated to each other. Read- 
ing/writing shows a statistically significant relationship; 
to the math and reading achievement post- test scores. Talk-, 
ing/working together is significantly correlated with 
post-test scores on the math and science tests: 

Note also that talking/working' together is significant 
ly correlated with the pre-test score' on the math test. This 
suggests that children who were advanced/ in mathematics 
achievement may have been viewed as a valuable resource in 
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the interaction of the classroom. In connection with another 
secondary analysis of these data, we have shown that child- 
ren who are chosen as good readers in these classrooms were 
more likely to-be talking 'and working together. From a sta- 
tistical point of view, this means ^that the impact of talk- 
ing and working together ,bn math post-test scores faces com- 
petition, from the pre-test score. -In the previous section on 
lateral relations, we did see that talking/working together 
no longer had a significant correlation with the post-test 
score, once the effect of the pre-test score was partialed 
out. 

The number of learning ^centers in use is correlated 
with talking and working together ( r=. 23 ;p< . 05 ). Unlike at 
the classroom level, differentiation is related to the mea- 
sure of mediating learning process. As described abov£, the 
presence of more learning centers in action means that there 
are more small groups .where children are likely to talk and 
work together. Again, this- relationship presents a problem 
of multicollinearity in a regress on where both differentia- 
tion and this behavioral variable are present. 

The same procedure was used for this series of regres- 
" sions as the last. The pre-test score was stepped in first; 
then the measure of differentiation; and finally the mea- 
sures «of mediating learning behavior. Table 17 presents the 

2 

beta weights for these predictors and the R for each re- 
gression equation. 



O ' '* Page 66 



INSERT TABLE 17 HERE • 

The observed frequency qf reading or writing is a 
significant predictor of gains on all leaning outcomes. 
The rate of talking and working together has a significant 
beta weight for gain's in the Science Mini-test, but not for 
the standardized achievement test. These results parallel 
the results found at the classroom level. It may be the case 
that lateral relations are also important for gains in the 
math test, but the problem of mult icol linearity may^ obscure" 
the relationship. .It will be recalled -that the rate of 

talking, by itself, did predict post-test math scores when 

i « - 

pre-test scores were held constant. 

The problems of multicollinearity are such that one 
cannot use indicators of disengagement along with these be- 
havioral measures in the same regression equation. In -the 
scoring system, if a target child were not reading or writ- 
ing or talking, s/he was likely to be disengaged. This is 
shown by the strong negative correlation between each behav- 
ioral ^measure and disengagement (See Table 15). 

.. Effect of Worksheets on Learning It will be recalled 
that the average number of worksheets per child, as a mea- t 
sure of productivity at the classroom level, proved to be a- 
powerful predictor of learning: .However, we were unable, to 
-use number of worksheets per individual child as a measure 
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of individual productivity because of , missing data and other 
problems. In a special contract with the state of Cali- 
fornia, the available worksheets for the target children 
were carefully scored on a! -number of dimensions for the qual- 
ity of performance (DeAvila & Cohen, 1981) 

The measure most closely related to productivity was a 
count of the amount drawn, and written on each week's work- 
sheets in response to the questions requiring the student to 
describe procedures and /results, of their activities. This 
measure of effort and productivity showed gains over the 
weeks of the curriculum. Furthermore, when the scores „were . 
averaged, and the effect of the pre-test score partialed 
out, there were significant partial correlations between the 
amount written and drawn 'on the worksheets and gains on the 

m r 

standardized achievement test and on the science Mini-test. 
Furthermore, other measures of the goodness of the infer- 
ences- the child made on the worksheets, the quality of the 
sentence structure, and the correctness of the computations 

u * * 

"were also .-significantly related to gains in all test scores, 

:. 9 \ 

using partial correlations. - 

Parallel to the finding for classrooms, "worksheets are 
also important for learning at the individual lever. The 
fact that reading/writing predicts gains on the Science 
Mini-test means that the worksheets were important. The 
thoroughness and correctness with which these worksheets 
were filled out was strongly related to doing well on the 

s 
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content-referenced test, This aspect of implementation 
proved to be quite critical to good results. 

We did attempt some regression equations where read- 
ing/writing and working/talking together were stepped in 
along with the amount written and drawn, as a measure of pro- 
ductivity. However, the worksheet measure did not prove to 
have"X~signif icant beta weight in this context. 

This finding raises an interesting problem of the lim- 
its of regression "analysis for our purposes. Regression 
treats all these variables as if they were occurring at the 
same point in a process, but actually, they are better 
thought of as taking place at three stages. The student's 
prior level of achievement and the task organization of the 
classroom set the stage. Next comes the learning behavior 
which is a^med at the production of worksheets. As a product 
of this effort comes the quality, and quantity of performance 
on the worksheets. In future analyses, a path model may turn 
out to be the best way to characterize these data. 
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DISCUSSION 



Review of Major- Results 



Variation -in Implementation 



There was considerable variation in the way this curric- 
ulum was implemented in the nine classrooms. Teachers clear- 
ly could not manage the level of differentiation (12 learn- 
ing centers per week) that was originally envisioned by the 
developer. Even after the recommended number was cut to six, 
the observed number of learning centers in simultaneous oper- 
ation suggests that many rooms operated with fewer than six 
at a time. Nonetheless, the observed level of differentia- 
tion was markedly higher than that in the math classes of 
the same teachers (Rosenholtz, 1981 ) . 

There was also marked variation in the amount of talk- 
ing and working together among the children. Some teachers 
were much better able to delegate authority to children to 
assist each other and to take responsibility for solving the 
problems of the curriculum and moving through the learning 
centers than others. Some tried to use their aides to main- 
tain as much direct supervision as possible using somewhat 
larger groups of children. 

There was also marked variation in the stress placed on 
completing the worksheets in the curriculum. Some teachers 
did not complete .the curriculum-. Others completed the curric- 
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ulum but did not place much stress on filling out and turn- 
ing,in the worksheets* 

Implementation of Teacher Role 

In the three day workshop, teachers were instructed in 
how to make some decisions "about special attention certain 
children would need. This -was an aspect of the curriculum re- 
quiring non-routine decision-making on the part of the teach- 
er. She was to extend activities ' of children. who were capa- 
ble of carrying out the tasks at a higher level. She was to 
give specific constructive feedback, based on the actual 
•worksheet performance of individual students. 

Analysis of the data on teachers showed that there was 
very little of this type of behavior on the part of teach- 
.ers. They were very busy trying to keep the children correct- 
ly oriented 'to the challenging activities. They found the 
tasks very challenging themselves and were often only one 
step ahead of their classes. 

Classroom Processes and 1 Learning Gains 

There were strong overall learning gains among the 
children, not only on the substance of* the curriculum, but 
on the skills measured by standardized achievement tests. 
Analysis of these gains by DeAvila phowed that there were al- 
so gains in cognitive development and gains in English pro- 
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ficiency among those children who were not proficient in the 
fall (De Avila,1981). In this analysis we were able to link 
gainS to specific aspects of classroom processes. 

Analysis of gains on the content-referenced science 
test showed links between learning and talking and working 
together as well as links between learning and reading and 
writing. Furthermore, working out the problems on the work- 
sheets was linked to gains on this test. In all these analys- 
es, the effect of pre-test score was held constant. 

Analysis of gains on the standardized math test showed 
correlations between reading and writing in. the context of 
the curriculum and post-test score. Also predictive of math t 
score gains were correct computations on the worksheets and 
the drawing of correct inferences. Furthermore the sheer num- 
ber of worksheets completed in a classroom predicted average 
classroom improvement oh the matli test. < 

Lastly, analysis of ga:.ns on the standardized reading 
test at the individual level showed that .reading and writing 
in the context of f:he activities were predictive of improved . 
scores. Also, the more learning centers that were available ( 
to the child, the greater were his/her gains. Finally, the 
quality of the writing on the worksheets was predictive of 
gains on the reading test. < 

Lateral Relations , 
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It was hypothesized that given the level of complexity 
of this, curriculum, interdependent relations among the stu- 
dents would reduce task uncertainty and would therefore lead 
to more learning. There was gobd support for this hypothesis 
in the relationships between the proportion of students who 
were seen talking and average classroom gains on the Science 
Mini-test. „ At the individual level the rate of talking and 
working together among the target children was predictive of 
;gains on the Mini-test. There were also some significant re- 
lationships between the talking among the target children 
and their gains on the standardized math test. 

t 

Dimensions of Implementation 

It was hypothesized that each of three dimensions of im- 
plementation would be predictive of learning outcomes: Dif- 
ferentiation of the technology; Productivity; and. Mediating 
Learning Process. There were independent measures taken of 
these dimensions at the classroom level and ac the level of 
individual target children. Results showed links to differ- 
ent learning outcomes' for the different dimensions. However, 
the basic results at the classroom and individual levels 
were similar. 

Productivity, as measured by the average number of work- 
sheets per child in a classroom, showed positive but not 
statistically significant relationships to the average gains 
on the CTBS math test at the classroom level. The relation- 
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ship was also positive ^but weaker for the Science Mini-test. 

i 

4 

At the individual level, productivity, as measured by disen- 
gagement among the 'target .children, was a significant prer 
dictor of all learning outcome measures, holding constant , 
pre-test scores* Finally, productivity, as measured by the 
amount written and drawn on the worksheets, showed signifi- 
cant partial correlations with the post-test scores of the 
math test and the Science Mini-Test, with the pre-test score 
partialed out. 

Of the major variables prescribed by the developer as 
important for learning, reading and writing were strong pre- 
dictors of gains on the math test at the individual and 
classroom level* The frequency of reading and writing among 
target chldren was a signficant predictor of gains on the 
Mini-Test and CTBS Reading test, holding constant the 
pre-test score. The second important mediating behavior was 
talking or talking and working together. This behavior 
showed strong, links to learning gains on the science test at 
the classroom ani the individual level. Manipulation without 
talking showed negative relations to learning at the class- ^ 
room level, but not at the individual level. 

Differentiation, the third v dimension, did not show 
strong direct relationships to the -learning measures. In- j 
stead it appeared to interact with the other dimensions. For ^ 
example, when the proportion of students in classroom read- 
ing or writing was considered jointly with the level of dif- f 
ferentiation, the power to predict learning gains on the 
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math test was. greater than, when ei'ther dimension was cdhsid- ' 
©red separately. Similarly, when the number of worksheets 
was considered jointly with differentiation, the power to 
predict gains for the math test 'in a classroom was improved 
over either dimension separately; Only for reading, at the 
target child level, did differentiation appear as^a signifi- 
cant predictor in the regression equation. 

Differentiation was correlated with the number of 
weeks of the science curriculum the teacher completed; it > 
thus had an indirect link to the average number of work- 
sheets turned out per child because if the curriculum were 
not completed, the child had access to fewer worksheets. At 
the individual level, it was. also linked to talking and work- 
ing together,' so that target chiTdrfi were more likely to be 
found talking and working together in classrooms where there 

were more learning centers -in use. 

v 

Importance of the Teacher 

The first issue to be discussed is the significance of 
the teachers' failure to carry ou& recommended teaching be- 
^iravaiors. Does this mean that the learning gains were ach- 
ieved "^ithomt benefit of the teachers' efforts and skill? 
It is clear that much of the success .of the students was not 
dependent on' what the teacher said in the way of feedback 
and on various kinds of individualized instruction. However, 
these task-instructions were very carefully prepared and had 
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been rather well pre-tested on migrant labor children in N*»w 
Mexico. M*ny of the tasks had a way of providing instant 

feedback to the student it either "worked" or it didn't. 

Furthermore the peers gave much feedback 'to each other while 
•irking on the tasks side by side or interdependent^. Last- 
ly, the curriculum had redundancy in the multiple activi- 
ties; many of them taught the sameunderlying idea but in a 
very different media and mode.,; "-Thus iSsthe child didn't 
understand one activity, he might pick" up the idea with the 
next learning center teaching the same concept . Under these 
conditions of a carefully conceived and engineered 
-»rriculum, one might indeed conclude that the success of 
the curriculum was not as dependent on the teacher as is the 
case with more conventional curricula. 

However, it would be a great mistake to conclude that 
the teacher was unimportant to the running of thie curricu- 
lum. She had a critical role to play in orienting the child- 
ren to the learning centers, in setting up working relations 
between the children, in getting the children moving around 
between learning centers, and in seeing to it that work- 
sheets were completed and completed fully. This was more of 
> managerial than a direct* instructional role, 'some of our 
teachers managed it much, better than others. 

Irt this year's contract we did not analyze the data on 
coordination and control strategies of the teacher; that . 
task remains for next year. However, the findings on the im- 
portance of worksheets and lateral relations suggest the cri 

• o 
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' tical importance of the coordination and control functions 

of the teacher. 

One final point is in order. If we were able to help 
teachers more effectively in implementing the • recommended be- 
haviors, it might still be .the case',that the: learning out- t 
comes would be superior" to what was found in this study. 
Thus the significance of these particular behaviors is still 
( unknown.- < . " , 



Lateral Relations and learning 

* . « ■ 

The second issue, for discussion is the way in which lat 
.eral relations led ,to 'superior learning 1 outcomes on the con- 
. tent-referenced test. According to organizatioria^sbciology , 
interdependence among 'the workers under conditions^ of com- 
piexity reduces task uncertainty. This was almost certainly 
the"case for" children trying to find tfTeir way through a ndv 
el set of instructions at the learning centers. The tasks 
vwere* thoroughly challenging* to adult or. child. For many of 
• the .target children, there was additional uncertainty stem- 
'ming^.ffcin- thetfr inability to read, very well or to write the 
"answers to questions on the. worksheets. There were also a 
•': number- of Children in the target child sample who had limit- 
ed proficiency. .in >o*th English and Spanish. .These dhildren 
" - .ypvte need, access, to both languages in order to decode what 
.'"they were. expected tc do. For these children, peers repre- 



sented a valuable resource in finding out what they were sup- 
posed to K« doing. Without this help they might very well 
have missed the benefit of the learning center activities . 
Clearly the adults could not- be everywhere at or;ce giving in- 
dividualized assis^tajicje^^ \ 

Lateral relations may ha\e fulfilled multiple 'functions 
in learning the math and science concepts in the curriculum. 
In addition to reducing task, uncertainty as described above, 
it probably gave\ the children the\ppportunity to practice 
' all the new scientific vocabulary o^t loud, thus committing 
the words to working memory. There were many vocabulary 
items on the Science Mini-test. Students were also heard to 
give very fine explanations to each other, no doubt improv- 
ing the understanding of ,.the explainer as well as the "ex- 
plainee.* Many times, the group would brainstorm their way 
through to the solution of a mechanical or intellectual prob- 
lem.' 

The very act of talking with each other about the tasks 
is of critical benefit to children who show limited profic- 
iency in oral language. The children who were 'limited in 
both English and- Spanish proficiency learned gust as rapidly 
as their classmates in this bilingual curriculum. They were , 
scored ,as talking quite frequently in English? and their Eng- 
lish proficiency improved as a consequence of their experi- 
ence. Conventional classrooms, even those classrooms special- 
izing in English as a Second Language, rarely give much time 
to peer talk about v/Qrk. These classrooms contained many pro- 
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ficient English speakers, so children with limited English 

f 

proficiency had access to peers who spoke standard English. 
At the same time they had lingustic access to the .curriculum 
through the bilingual curricular material and through the 1 
teachers and aides who were found to use' both , English and 
Spanish (De Avila and Cohen, 1981') .» 

A final function of lateral relations is the improve- 
ment of the engagement of the students*. Talking and working 
together was strongly related to -engagement among the target 
children. There was a very high overall level of * engagement 
in this curricular setting. When children are not expected 
to sit quietly, but are permitted a more active mode of 
learning which involves talking to small 'groups of peers, 
the engagement level will be very high. This, in turn, has a 
favorable impact on learning. 

Gains in CTBS 

This curriculum was not originally designed to produce 
gains in reading and computation. The curriculum content 
does' have direct relevance to general concepts included in 
the applications section of the math CTBS.. In addition, the 
worksheet problems frequently asked the student to set up 
the computation, much as a standard word problem does. In 
the early versions of this curriculum, tested on children of 
migrant labor in New Mexico, gains in standardized achieve- 

* t 
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ment, tests were first noted. We included these' tests as part 
of our battery to see if these .gains would be repeated. 

4 

The findings, on these tests clearly suggest that the 
curriculum provides ample practice in reading, writing, and 
computing. Furthermore, -this practice appears to have^ a ^pay- 
off." in gains -on the CTBS measures. The significance of this 
finding is far deeper than the common research result that 
active practice and ac'tive learning time yields test, score 
gains.' In this case, 'the practice did not take the* shape of 
small group Work with t'he teacher, or seatwork,- or drill. 
Rather it< took place in a peer setting, where children could 
and did ask each other to read for them and to tell* them 
what to put down on the worksheet. Furthermore, ."when they* 
did read and write, it was in the context" of carrying 6ut an 
intrinsically interesting task, not as ah empty exercise. 
There was little eviceace.of direct instruction or feedback 
on any skill during this curriculum. 

in other words'", this was 'an alternative to direct instruc- 
'tion which still yielded a high level of active ^earning 
time/ simultaneously produc ing gains in thinking skills ,, in ' 
the math/science, area . g , ? - 

* The children in these schools were part of ^ special bi- 
lingual program, which provided teacher aides, special work- 
shops for teachers, -strong emphasis -on reading and math clas 
ses -and considerable testing of the attainment of teaching 
objectives. In other words, much of their regular program 
took the form of compensatory education. In the early analys 



^.s of learning outcomes, DeAvila found that the children who 
had experienced_FO/D show*. . superior test score, gains to oth- 
er children .of the same grade experiencing the same compensa- 
tory programs. (DeAvila, 1981 ) . 

Rosenholtz observed the math' classes of a sub-sample - 
of target children; these were. the same teachers who taught 
our curriculum. H6 found ability groups underdose supervis- 
ion, receiving far -more emphasis on routine computation than 
on^the conceptual side of the mathematics curriculum 
(Rosenholtz, 1981) . These' observations suggest that there 
were, at least two sources of the superior math scores of 
children in FO/D." One was the active method by which con- - 
cepts were taught at the learning centers in comparison to a 
tendency to neglect this side of the curriculum in math 
classes. The other source was undoubtedly all the extra prac 
tice in reading," writing and computation provided by the 
worksheets and instructions themselves. CTBS is administerd 
only in- English and does require reading skills as well as 

if « 

math skills. * 

A most interesting finding was that the more different 
learning centers we saw in use, the higher were the gains in 
the target child's reading scores. Evidently, the more in- 
st'ructions and worksheets they grappled with, the better it 
was for their reading skills. 

Currently, much is heard about the benefits of direct . 
instruction for children who are working below grade level 
in- academic skills (although exactly what is meant by "di- 
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rect instruction" is not always clear). These results : an 
counter to any conceivable definition of direct instruction. 
Here are children who operate well below the state testing 
norms, making sharp glins in"a classroom which is not organ- 
ized for direct instruction at all. Instead, there are multi- ^ 
pie tasks with multiple groupings of children functioning as 
interacting pairs and small group sr-taking responsibility 
for* their own learning. The. gains on the standardized ach- 
ievement tests are a by-product gained at the same time that 
the children are developing more abstract thinking skills. .- 
However, these gains do not occur by .magic. It is essen- 
' tial for an educator who wants to learn from the results of 
• this curriculum to realize that this is a very carefully pre- 
pared curriculum. The instructions are detailed and clear; 
they' are presented in English, Spanish and pictographs. 
There are carefully designed worksheets in English and Span- 
ish available for almost every learning center. All the mat- 
erials for the activities were boxed for each learning cent- 
er, so the children or teacher had only to open up the box ' / ' "> 
and "set up shop." The activities had been pre-tested; they 
had very high intrinsic interest and did not require a mid- 
dle class set of experiences to understand. The children 
were" told that it was legitimate to use each other as re- 
sources. Finally, this was not an "open classroom." Children 
were clearly told that they were to complete each learning 
center and worksheet. 
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Impact of Differentiation 

0 

9 

In many ways the results on the number of learning cent- ; 

r 

ers in use (the measure of differentiation of the curricu- 
lum) are the most difficult to interpret. It helps to remem- 
ber that all but ^thirteen of the FO/D observations fell into 

t 

a "high complexity" category developed by Rosenholtz ( 1981 ) . 
Thus when one look's at the results of variation in different- 
iation, one is looking at differences of. degree, given quite 
a high level- of differentiation to star. with. Even so, it 
was originally assumed that the more different activities 
the students experienced, the more they would gain on the 
contents-referenced test. This was really not the case, it is 
not 'clear that the level of complexity orignally mandated by 
the curriculum would produce markedly better results than we 
achieved. 

Some of the failure of the measure of differentiation 
to have a direct impact on learning can be explained from 
the intimate knowledge we gained of how different teachers 
operated". One teacher had a low level of differentiation at' 
any one time, but got through more worksheets than anyone 
else by giving the curriculum extra time, and by seeing to it 
that everyone finished their worksheets. . Another teacher 
had a high level of differentiation, but inadequate control 
of the worksheet production, thereby lowering productivity.,. 
This kind of observation suggests why it is that different- ■ 
iation does not produce gains by itself. Differentiation 
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does not tell enough about the .control system .iirtiier class- 
room. One has to consider worksheet production and different- 
iation simultaneously to arrive at a set of sufficient condi- 
tions for benefiting from the curriculum. 

Differentiation also has to be considered simultaneous- 
ly with lateral relations. There were teachers who went 
through the curriculum in a relatively mechanical way with- 
out sufficient attention to the process of talking and work- 
ing together. It may be , the case that unless differentiation , • 
resulted in small groups who taJ'-.id and worked together, one 
does not see the benefit" of different learning activities. 
Perhaps teachers who managed lateral relations particularly 
,well, produced understanding of the basic concepts of the 
curriculum with fewer activities. This interpretation is sup- 
ported by the finding that. classrooms where larger propor- 
tions of students were manipulating the materials without 
talking did more poorly on tests than rooms where more talk- 
ing was taking place. Classes with large percentages of 
children manipulating the materials may well have beeji class- 
es where the children did not understand too much of what 
they 'were doing and' were not using their peers to find out. 
In this case differentiation would benefit the class very 

little. , „ 

There are two implications of this discussion of dif- 
ferentiation. One is /that further data analysis will have to , 
move beyond the limitations of the regression technique to 
something like path analysis/ where we can test out these 



/ 
/ 
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more 'complex notions of alternative ways to achieve gains on 
the science test, notions that involve stages over time from 
differentiation, through the mediating learning process, to 
■the production of worksheets. 

The other implication is for the curriculum itself. 
This curriculum' could probably achieve excellent results 
without forcing the teachers to maintain anywhere near the 
level of differentiation originally envisioned. As a matter , 
of factT if teachers really did try to' have 12 learning centr 
" ers'' function simultaneously in classes of 28-30 children, 
"they might well have had a low level of lateral relations, be- 
cause to* few -children would be attach center. This was 
" probably an inheritance of the driginal setting of this cur- 
riculum in New Mexico where much larger groups of children 
.^ere taught simultaneously. It will be necessary for the de- 
veloper of this curriculum to consider which activities 
might 'be dropped and what core should be retained so as to 
k eep the important feature of redundancy of major concepts 
-fell* lessening the .managerial burden on the teacher. 

The exercise of trying to understand the impact of dif- 
ferentiation leads to a set of principles for working with 
teachers of' this curriculum. In a way, the issue of differ- 
' entiation is probably one of efficiency. If the teacher has 
good lateral relations and six or seven learning centers op- 
erating, along with tight control of worksheet production, 
. she-could- get-excellent results in a shorter amount of 
class time spent on the curriculum. Teacher #9, is an excel- 
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lent example of . tije benefi-fcg-o f thi s approach. If the teach- 
er tries to maintain more direct supervision, while maximiz- 
ing worksheet production, then she is gfcing to have to spend 
much more time working with a lower level of dif ferentia- > 
tion. She will face the additional drawback of having sacri- 
ficed lateral relations to direct supervision. We* will under- 
stand more about these strategies of direct supervisees vs. 

i 

delegation as a* result of next year's analysis*. 



Engagement and Learning 

*> * 

> \* 
This model of classroom organization produces very high 
levels of engagement among language minority children. It 
would undoubtedly be successful in other academically hetero- 
genous settings. It is, however, critical to remember that 
this engagement was predicated upon full access to both lan- 
guages, along with access to English speaking children. With 
this proviso/ the general model of classroom organization 
represents a challenging alternative to individualization in 
dealing with academically heterogenous^' classrooms. It did 
not have' the difficulties of elaborate diagnosis and pre- 
scription,, nor the burden of elaborate record keeping teach- 
ers find so objectionable,. Nor does it run the risk of degen- 
erating, into nothing more than individualized seatwork. The 
adjustment to- individual need comes from the open character 
of the tasks, which can be done in different ways by differ- 
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ent children, and from the access to many different resourc- 

* 

es for assistance* 
' it does require a very carefully prepared curriculum 
• with tasks designed to be carried out »t different levels of 
cognitive development. Without special training in the under- 
ling developmental theory, .it is difficult to imagine the 
• typically trained teacher creating such a curriculum. 

It also requires the teacher to delegate authority to 
■ the learner to complete the tasks and to delegate authority. : 
" to lateral relations. Rosenholtz found that under c6nditions 
of high complexity, the use of lateral relations was ah im- 
portant precondition for a' high level- of task*' ; 

a. . 
engagement ( 1981) . 
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SUMMARY AND CONCLUSIONS 



We have reported the analysis of data on implementation 
of a complex curriculum' and a battery of learning measures. 
The curriculutfi/ F inding Out/Descrubrimiento , was designed 
£b teach thinking skills to language minority children by E. 
D~ Avila. THere were 170 different activities in math/sci- 
ence to be csed over 14 weeks. With the use of learning 
centers, twelve activities were planned "per week. The activi 
ties were designed tc teach thinking skills rather than 
facts of science or routine arithmetic operations. Using de- 
velopmental principles, beAvila selected those activities 
which could be carried out by children operating on differ- 
ent developmental levels. The student who completes the cur- 
«• 

riculum has m^ny opportunities to work with the same basic 

* -* 

concepts; the activities vary the media and mode, but sys- 
tematically repeat the same underlying concepts. All instruc 
tional materials are prepared in English, ^Spanish and picrtc- 

o 1 

graphs. % 

' Nine bilingual ' classrooms, grades two through four, par 
ticipated in the project; there were 307 children*" and nine . 
teacher-aide teams/ The schools were located in five dis- 
tricts in the San Jose area. Teachers and aides experienced 

a three day workshop ^training them in the use of the curric 

** 

ulum activities and in the recommended classroom managfcmerft 

o 

technique^* There ..was one follow-up workshop in mid-ypar. 



^ Thes, classes .were made up largely of children of Hispanic 
. background with a small proportion of. Anglos, Blacks and 

' Asians. v Parental background was working class and lower 

« 

•white collar. There were a few children from welfare famil- 
ies. Children had varying levelsoof language proficiency in 
.English and Spanish. 

This curriculum required a decentralized classroom org- 
anization. There were multiply learning .centers operating si 
multaneously . Each center had different activities with dif- 
ferent materials and worksheets. Children, had to take re- 
sponsibility to progress through each learning center and 
fill out the worksheet for £hat center's task. Teachers were 
instr^cteii to ^legitimize peer woirk relationships by telling 
the "children that they had the right to ask anyone* else at 
their qeriter for assistance 'and the duty to assist anyone - 
who asked for help-. Groups working at each center were heteij 
ogenous academically and linguistically. 

This was, not a demonstration project .where extensive 
funds we're invested in teacher preparation or in the ^hiring 
of master teachers. Instead these were teachers' who wanted 
^o" learn aboift the teaching of elementary science and who 
^felt that** language minority children should have access to 
science material's. At the time this curriculum was implement 
ed, science was, for all practical purposes, missing from - 
the curriculum of the schools th^t were in the study. 
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In addition to an extensive battery of pre and ~ 
post-test measures of learning, the data bank included 
•detailed measures of classroom organization, teacher behav- 
ior and observed learning behavior of a sub-sample of target 
children. These instruments were designed to measur'e rele- 
vant sociological features of the classroom as well as speci 
f ic features of this curriculum. The instruments were develo 
ped by Cohen and Intili out of their years of work with the 
Environment for Teaching Program at Stanford. 

Students who participated in the curriculum showed sig- 
nificant gains on CTBS math and reading tests, a. test of cog 
nitixce development! a test of oral English proficiency, as 
.well as on the content-referenced test developed for this 
curriculum^ Beyond these overall learning outcomes, the anal 
ysis in this report linked specific gains on learning mea-. 
sures to observed behavior and written performance during 
the weeks of. the curriculum. The following were the major re 
suits: a 

1. Talking and working together was a predictor of 
aains on the content-referenced test, both at the overall 
classroom level and fpr the sample of target children. 

2. Reading and writing behavior was a predictor of 
qains on the CTBS tests, math and reading, - both at the class 
room level and for the sample of target children. 
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• 3.Tne quality of performance on the worksheets was a 
predictor of gains on standardized tests and on the con- 
tent-referenced test, ' 0 

*. The level of engagement on the task was unusually ^"-f 
high; 19% of the target children were never seen off -task; 
only -6% were found to be disengaged more than 30% of the 
time. Nevertheless, disengagement was negatively related to 
gains on all test -measures. •• - * 

All these analyses were carried out with correlational 
techniques in which the effects of t||^^)re-test scores for 
classrooms and individuals were held constant when measuring 
the effect of a process variable on learning outcomes. 

A Sociological View of Student Interaction * 

Several sociological hypotheses were tested in these 

o 

* data. Glassroom organization was conceptualized as work ar- 
rangements and instruction .was., conceptualized as technology. 



In this way the work of the^sociologists who 
^^prgai^i^atTo'ns, wa? _app>ied^td* clas sroom ins_tc 



have studied , , 



etion.' rt wa"?.% 



-*i^^7hyp^ work relations among , the • 

^r^^-cfiltd reduce task uncertainty and thereby improve 

i - - • • - « 

:ui ; leiarning .outcomes. The fact that different .teachers* used lat 
eral relations among the chldren in varying degrees allowed ■ 

, - us to, test this , hypothesis. As cited above, this hypothesis 

m & 

"' .. received strong support in the finding that talking and 
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working together was a predictor of learning on the con- 

•© 

tent-referenced test, 

A Sociological View of Implementation 

• o 

Implementation was conceptualized as having three di- 

* l« 

mensions: differentiation of the technology; productivity of 
the student-workers, and occurrence of learning behaviors 
prescribed by tfcie curriculum developer. It was hypothesized 
that the degree to which each of these three dimensions was 
implemented in the "class rooms would predict learning out- 

4 

comes . 

Productivity and the prescribed learning behaviors 
proved to be direct predictors of learning outcomes. Degree 
of differentiation was only linked indirectly to learning 
outcomes. Differentiation appeared to 'interact with the 
other two dimensions, such that optimal learning outcomes 
were produced when the instruction was more differentiated 
a "<3 a high level of individual productivity was present. 
Likewise, optimal learning outcomes were produced .vwhen more 
differentiation was accompanied by more student interaction 
(a prescribed learning behavior). 

c 

0 

Implications- and Conclusions 
A General Approach to Instruction 
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This was not just an evaluation study of a particular 
curriculum. .U"ing 'a sociological view, this curriculum may 
be seen as one example of a highly differentiated, rational- 
ized type" of instruction. Other highly differentiated -curric- 
ula, such as many of the science curricula for the element- '« 
ary schools, would be.. expected to have the same difficulties, 
with implementation experienced by these nine teachers. They 
are likely to cut down\n the level of " differentiation recom- 
mended by the developer because they do not "know how to dele- 
gate authority to lateral relations among- the children. They 
also are not. uniformly conscious of the necessity to control 
student output in ways other than routine supervision. 

The results of this analysis suggest how these problems 
might be handled. Teachers can be provided with general prin- 
ciples concerning these management problems rather than de- . 
manding that they faithfully implement every part of the Cur- 
riculum. Recognizing that they invariably make adaptations, 
they can be instructed not to sacrifice lateral relations or 
worksheet productivity with whatever changes they choose to 
make. Furthermore, specific assistance and modeling in how 
ro delegate authority to children and how to maintain con-: 
trol over a decentralized system is ih 'order*: The ''teacher 
may come to understand that s/he can cut down on differentia- 
tion, but not at the expense of the other two dimensions. 

c 

t 

An Alternative to Individualization and Direct Instruction 
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The success of this approach in an academically and lin 

0 

guistically -heterogenous classrooms suggests an alternative 
to either individualization or direct instruction. This cur- 
riculum/approach features interacting students who take re- 
sponsibility for completing their learning tasks, and ser- 
iously challenging learning materials with a high level of 
intrinsic interest. The teacher dqes no€ diagnose or pre- 
scribe, nor does s/he carry out direct instruction, recita- 
tion or drill. The teacher plays a critical managerial role 
at minimum* „ 

This approach produces very high levels of engagement. 
Engagement produces active learning time and thus measurable 
gains in learning. 

Basic skill improvement is achieved through practice in 
c the context of intrinsically interesting tasks. Reading \ 
writing, and computation, have instrumental value in the com- 
pletion of the learning tasks. It is possible to provide 
practice in basic skills in this way in curricula witn a 

_ * 0 

wide .variety of teaching objectives. In this case the curric 
ulum aimed ut the development of thinking skills but pro- 
duced gains in basic skills though active practice 9 in a con- 
text that" «nade sense from the point of view of the learner. 

t 

These gains in the? basic, skills in no way compromise the 
"achievement of the primary objective of the curriculum. 
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The success of this curriculum/approach , however/ is 
based on, some important conditions that would probably have 
to be met by any designer of instructional settings ♦ The cur- 
iriculum materials were challenging intellectual tasks and 
were_extremely carefully prepared with instructions in two 

languages and pictographs. The tasks were open-ended " 

allowing children of Varying developmental levels to carry 
out the activities in different ways. Basic concepts were 
taught through multiple activit#)s with differing media and 
modes? The learning materials were items familiar regardless 
of class. or cultural .background. Furthermore/ th^ teachers 
received the support of an aide and the careful preparation 
of all teaching materials. 

In addition to these features of the curriculum and its 
preparation/ there were important conditions of the class- 
room organization. Heterogenous small groups were usec^The 
social structure made it legitimate for children to use each 
other as resources. Finally, there was a strong .* set of de- 
mands/ .requiring each child to proceed to each learning cent- 
er and finish eac^i task and accompanying worksheet. 

Although , this method of organizing classrooms and in- 
struction is "swimming against the educational stream" which 
is now returning to more direct methods of instruction/ it 
is by no means impossible to achieve with ordinary class- 
rooms and teacher-aide teams. There are undoubtedly curricu- 
lar materials which could be adapted to the approach. 
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In closing , we hope it has become clear that sociologi- 
,- w cal approach to classroom organization and instruction can 

yield new and different approaches to increasing educational 
l~ * productivity. 

• J 



4 
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Footnotes 



1. In this instrument, the coder could not distinguish 
vhethef talking was about the curriculufn or not. Observer 
comments, however, indicate that most talk *?as task-related, 
•Analysis of the data on individual target children tends to 
confirm this observation. In the Target Child Instrument, 
talking was broken into "on task," and "off-task, " There was 
very little "off-task" talk in comparison to "on-task" talk. 
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TA^LE 1 % o 



Description, of -the Participants in the Experiment 
by Grade Level and Student Age 

' Number 

Grade of N°of Students whp Consis- Average Age 

'Level Classes tently Participated in Years. 



2/3 2 % » . '^9 8.33 

3-5 * - 134 ; 8.66 

3/4 1 32 . 9.25 

4 1 26 . 9.66 



TABLE 2 



'Description of the Student Participants in the 
Experiment by Level of ^Language - 

*Frcf iciency - v 

Level of Language Proficiency on Pre-Test ' N 



Minimal .Language Proficiency^ in either 

English or Spanish 21 / 

Limited, Bilingual b 69 

Partially Bilingual 33 

Monolingual in English . 85 

Monolingual in Spanish . 22 

Bilingual in Spanish, and English t 23 

TOTAL Students Tested 253 



TABLE 3 

Reliability of Teacher Observation Instrument 



Observer Number of Times Average % 

Number • Reliability Was Agreement 

Assessed _ 



2 
3 
4 
5 

6. 
7 

8 ) ' 

9 

10 
11 

o 

12 * 3 



13 



3 -90 
1 .91 



1 -92 

.88 

3 -86 

1 , -93 

1 .93 

2 . -89 

3 -91 
3 -91 



<s5 



.89 



2 . , . « 91 

\ 

Grand Mean = .90 
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TABLE 4 

Reliability of Whole Class Observation Instrument 



Observer Number 



Number of Times 
Reliability Was 
Assessed 



Average % 
Agreement 



. 1 
2 

9 

4 
5 
6 
7 
8 

, 9 
10 

ir 

■ 12 



/ 



:3 
2 
1 
.3 
2 
2 
4 
2 
3 



.90 
.90 
.90 
.91 
.85 
.87 
.98 
.85 
.94 
.95 
.90 



Grand Mean = . 91 



.Observer 
^Number 



1 
2 
3 
4 

,5 
6 • 
8 

10 
11 
12 



TABLE 5 

Reliability of Target Child .Instrument 



o 


Number of « Times * 
Reliability Was 
Assessed 




Average % 
Agreement 




1 






. „93 




2 


• 




.91 




3 

<- 






.89 


* 








.92 


< 


J » 

2 






.89 
.91 


s 


2 

'• 1 






.98 
.87 




8 






.93 




1 




* 


.76 



Grand Mean = .90- 
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TABLE 6 

C 

Classroom Variation in Criterion Referenced Test and Standardized Achievement Test: 

CTass Mean Scores on Pre and Post-Test » 

Teacher Number * 

Student Outcomes: Mean Class Scores 1 2 j 4 5,6 7 8 



Science Mini-Test; 


:Pre 


49. 


3 


54 


.5 


48* 


1 


40. 


0 


43 


.3 


43. 


.0 


42. 


.4 


49. 


.2 


50. 


1 




Post 


56. 


.9 


65 


.6 


60. 


9 


46. 


5 


54 


.5 


47. 


.1 


48. 


.2 


54. 


.1 


60. 


8 


CTBS Math Test: 


Pre 


42. 


.1 


46 


.4 


48. 


4 


27. 


3 


26 


.,5 


32. 


.9 


42. 


.1 


39. 


3 


58. 


8 




Post 


67. 


.7 


60 


.5 


66. 


6 


47. 


8 


56 


.1 


44. 


1 


-82. 


.7 


56. 


.7 


70. 


6 


CTBS Math Applica- 


-:Pre 


9. 


.4 


9 


.7 


8. 


5 


6. 


3 


5 


.C 


7. 


1 


7. 


.7 


7. 


8 


12. 


5 


tion 


Post 


14. 


.3 


12' 


.4 


12. 


9 


8. 


2 


11 


.2 


7. 


4 


20. 


,0 


11. 


2 


16. 


5 
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TABLE ,7 • 

Curriculum Weeks Completed by Each -Classroom 



Teacher Number 



Curriculum « Weeks 



1 

,2 
3 
4 
5 
6 
7 
8 
9 



14 
14 
8 
9 
11 
14 
14 
8 
13 



112 
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r ' 
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Variation Among Teachers in Percent of Students Involved in Mediating Learning Activities, 

Differentiation of the Curriculum and Student Productivity 

* 

implementation Variables 

Mediating Learning Process 0 
(Average Percent of Students Observed): 
, Reading/Writing 
talking (only) 

Talking while Manipulating Materials 
Manipulating Materials Without 
. Talking 

Differen tiation of the Curriculum § 

' \ H . 

(Average Number of Learning Centers 4.1 3.8 4.8 6.3 4.7 5.1 6/6 2.3 6.9 ^ 
in Use During Period) £ 

Productivity of the Class 

(Average Number of Worksheets Com- 
pleted by a. Child in tfie Class over 
the Course of Activities) 









"Teacher 


Number 










1 


2 


3 


4 

* 


5 • 


6 


7 

0 


8 


9 

■ 


11% ' 


. 4% 


12% 


> 6%. 


6% 


9% 


13% 


7% 


9% 


.9% 


6% 


9% 


7% 


.16% 


5% 


7% 


. 5% 


18% 


17% 


22% ° 


19% 


22% 


26% 


28% 


28% 


18% 


34% 


26% 


11% 


20% 


20% 


27% 


31% 


17% 


21% 


12% 


4.1 


3.8 


4.8 


6.3 


4.7 


5.1 


6/6 

» 


2.3 


6.9 


104 


65 


62 


46 


69 


42 


67 


34 


73 
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TABLE 10 



Average Frequency Per Three Minutes for Targe 

Working Together with Peers: 
* Means and S.D.'s for Nine Classrooms 

Teacher "Av. Rate Per ' S.D. Number of 

Number Three Minutes Children 



1 1.77 

2 1.84 

3 2.23. 

4 1<65 

5 2$ 08 

6 f. 95 

7 #.22 

8 2.04 

9 2.49 



. Grand* Mean = 2.04 



.89 7 

.80' • 11 

.59 13 

.69 14 

.52 12 

. 99 10 

1.19 9 

' 1.06 12' 

.84 12 

.85 N =100 
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TABLE 11* ~ 



Relationship of Observed Behaviors to Post-Test Scores: 
Partialing Out Effect of Pre-Test Scores 



Rates Of Observed 
Behavior- 



CTBS Content-Referenced 
Math science Test °* 

(n=65) (n=97) 



Talk 

Manipulates 
Manipulates f Tcilk 

1 Works Together 

(Work Together) (Talk) 



41*** 

.21* 
,20* 
,03 - 
.09". % 



.15 
, -.05 
.17* 
.21* 
-) .26** 



* p < .05 
** p < .01 
*** 



p < .001 



.» 

1 „. 



" © 
lERIC * 
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ZERO ORDER CORRELATIONS 'AMOHk IMPLEMENTATION AND OUTCOME MEASURES 
Average * Average # Average X Average X Average % Average % 'l$Ocldin§7 v * T aTk 



Worksheets Learning Reading/ Talking 
Completed' Centers Writing ' (No 
In Use 



Average Number 

Worksheets 

Completed 

* 

Average Number 
Learning Centers 

muse > a 

Average Percent 
heading/ , 
Writing 

Average .Percent 
Talking 

(No Manipulating) 

Average Percent 

Talking 

Total 

o 

Average 5 Percent 
.Manipulating 

Index 
» Reading/Writing 
and Worksheets 

Index 

Talk and <1 
Korksheets 

Index 
Total 

Implementation 
Science 

P0St V r 

_TestN N ' . 

CTBS X 
Kith Total x 
Post * 



2 

.07 



3 

.35 . 
.35 



Manip.) 
. 4 

.43 
.39 
.00 



Talking 
Total 



5 

.22 



.65 



.04 



(.88) 
X 



Manip. 
6 

-.06 
-.24 
.15 
-.21 
-.21 



Writing S 
•J Worksheets 
Worksheets 



7 



(.83)* 



.25 



(.81) 



.27 



.16 



.05 



.X 



8 

(.85)' 
.27 
.21 « 

(.84)' 
(.43) 

-.13 

(.65) 



Index 
Total" 
Imp. 



9 

(.72)* 

(.64)* 

(.64)' 

(.69)' 

(.65)' 

-.10 

(.83)' 

(.84)' 



TABLE 13 

THE RELATION OF IMPLEMENTATION TO LEARNING OUTCOMES, * 
CONTROLLING FOR MEAN LEVEL OF' KNOWLEDGE OF MATH/SCIENCE BEFORE IMPLEMENTATION 

(n = 9 classes) 



Partial Correlation^ th 
Learning Outcomes (DF=6) 



Implementation Variables 
(Standardized Scores) 



Math Total 
Subscale 
Score on 
CTBS 



I, Individual Relations of Dimensions of Implementation to Outcomes 

Productivity:* Average .number of worksheets completed by students in a class. 

Differentiation of Curriculum Process: Average number of learning centers 
used in a class* 

Mediating Learning Process: 

Percent of class observed Reading/Writing durin'g FO/D periods 
Orcent of class observed Talking or Discussing with others. 
Percent of class observed Talking and Manipulating materials during 
FO/D period. 

Percent of class observed only Manipulating materials during FO/D period. 



II. 



lie 



III. 



Indexed Measures of Implementation (likert type scales) using Two Dimensions 
of Concept" " 

Mediating Learning Process and Producti vi ty :■ . ° 

Percent Reading added to average number of worksheets completed in a class. 
.Percent Talking added to average number of worksheets completed in a class. 

Productivity and Differentiation: Average number of worksheets completed in a 
class added to aveVage number o. c learning centers in use.* 

Indexed Measures of Implementation (Likert type scales) using Three Dimension s 
of Concept" — — : — 

Mediating Learning Process, Productivity and Differentiation 

, Percent Reading added to average number of worksheets produced and average 
number of learning centers in use. 

Percent Talking added to average number of worksheets produced and average 
* number of learning centers irruse. 

■ Total Implementation: 

\ • Percent Talking added to percent Reading, average number of worksheets 
' ^p roduced, and average number of learning center s j^use. 



.49 r 
.27 

.57 
.13 

.09 

-.13 



.66 
.39 

.54 



.66 
.41 

.57 



** 



Application 
Subscale 
in 

Math CTBS 



Score, on 

Content 
Re ferehced 

Science Test 



ni<.05i 



.44 
.32 

.57 
.21 

.23 

-.31 



.62 
.37 

".54 



.65 
.45 

> i 

.60 



** 



.31 
.32 

-.02 

,~d34j 

'M 

-.23 



** 



D> - 

id 



.17 
.56 

.39 
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.25 
.56 

.44 



TABLE 14 ' * * 

* * • " « 

fl-Frfe.quency distribution of Rates of Off Task Engagement 

%-Time ' n* * % of children 

Off-Task in Target- 
Sample 

# 

' 0% 19 • « \ 19% 

_1% -0.0% ^ *48 ^ 48% 

10". 4% - 13.6% 12- . . 12% 

fe'5% - 18.9% 10' 10% 

•24.1% - 27.1% 1 .5 k ■ 5% 

33.9% - 44.6% $i *. 6% 

Total 100 100% 



TABLE 15.' 

Zero Order Intercorrelations of Implementation and Learning Measures: 
Individual Target Children 



I > 

• 


Math B Read B 

*' • 


Mini B 


Math A 

• 


Read A 

• 


Mini A 


L.C. ' in Use 


Read/ 
Write 


Work/ 
Talk 


Off 
Task 


i " ; " Math B 


1.00 .614*** 


.462*** 


.634*** 


.504*** 


.403*** 


.201 


.258 


.337** 


-.379** 


Read B ■ 
j ;." Mini B 


1.00 


.584*** 


.532*** 


.844*** 


.581*** # 


.079 , o 


.325** 


.Q94** 


-.326** 




1 rvrv 

1.00 




A? 7*** 


.637*** 


-.009 


.202 


.267* 


-.198 


I Math A • 








.561*** 


.481*** 


.133 


-.037 


.427*** 


-.182 


• 

; : . Read A 


j 






1.00 


.682*** 


-.071 


.152 


.082 


-.241* 


of' 

f Mini A 


<*► 








1.00 


-.128 


.031 


.128 


. -.062 


\ L.C.'s 
.-in Use 


i 

> 


c 








1.00 


.141 


.231* 


-.223* 


Read/Write 




<3 










' l.Op 


.016 . 


-.137 



'Work/Talk 
Off Task 



1.00 



-.353** 
1.00 



&2 



;t-Test scores; L.C.'s in Use = Average No. 



Uariahlps- Tp«?t A refers to Pre-test scores; Test' B refers to Post 

Variables, ^st A refers Kea ^ rite - Average Frequency of Reading/Writing observed for Target 

SIS Lrk/xSk = Product of Average rate of Target Child Talking About Tasks multiplied by Avera 



Child; Work/Talk = Produc 
Rate o 
Targe 



irSiTaLi WorUng Spheral Off-Task - Avenge Race of Off-Task Behavior for 
t Child. ' * • 



.* p<.05 
** p<.0i 

***» p<.ooi 



N = 63 



TABLE 16 

* 

Regression on Three Learning Measures of Observed Rate of Disengagement for Target Children: 
Holding Constant Pre-Test Scores and Classroom Level of Differentiation 



Dependent Variable 



Math CTBS Post-Test 



Predictor 



Math CTBS Pre-Test 

No. Learning Centers in 
Use 

Rate Off-Task 



Beta 



.578 
.066 



-.259 



F 



39.30*** .402 A 
.508 .416 



7.61** 



.478 



Read CTBS Post-Test 



Science Mini Post-Test 



Read CTBS Pre-Test 
No. Learning Centers in 
Use. 

Rate Off-Task 



Science Mini Pre-Test 
No. Learning Centers in 
Use 

Rate Off-Task 



.828 
.115 

-.101 



.633 
.039 

-.151 



156.37*** 
3.06* 

2.24* 



44.02*** 
.16 

2.41* 



.712 
.731 

.741 



.406 
.411 

.433 



* p<.05 
** -p<.01 
*** p<.001 



TABLE 17 



0(\ 



■ Regression on Three Learning Measures' of Observed Rate of Reading/Writing and Talking/Working 



* p<.05 
** p<.01 
*** p<.001 



Together: Holding Constant 

« * 


Pre-Test Scores and Classroom 

* 

* 


Level of 


Differentiation of 

c 


Target Children 


Dependent Variable 


Predictor 


Beta 


<• 


r r 2 


Math CTBS Post-Test r 


Math CTBS Pre-Test 


.611 


37.57*** 


0 -a 

.402 


0 


No. Learning Centers in 


.069 


t .54 


.416 




Use 










Read/Write 


.270 


9.94** 


.487 




Talk/Work Together 


.060 


. 300 


.490 


Read CTBS Post-Test 


Read- CTBS Pre-Test 


.824 • 


173.40*** ' 


.712 




No. Learning Centers in 


.112 


3.02* 


"7 11 
. / jl 


• 


use 




8.59** 






Read/Write 


.188 


.764 




Talk/Work Together 


-.001 


.000 


.764 


Science Mini Post Test 


Science Mini Pre-Test 


.603 


39.47*** 


.406 




No. Learning Centers in 


.009 


.00 


.411 




Use 










Read/Write 


.179 


3.76** 


.441 




Talk/Work Together 


.186 


3.81** 


.473 



N = 63 



m 

Pi 
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Teacher Observation * 2 

Guidelines for Scoring 

Teacher may be watching disengaged students or students 
in t ransition. 
Academic Task : 

Teacher may be g rading papers , correcting work sheets or 
working with work summaries* This category includes non- 
interactive .academic teacher role behavior* 

♦ 

Takin/r ?:otes : 0 

This category refers specifically to taking notes on children 
who are engaged in the MICA curriculum. 

Interaction with other adults 

Si/male. : > 

This is a non-verbal communication between the teacher and 
another adult. For example, may be signalling to go ahead 
with * activity , that it is tirhe to close down the activities, 
or that she wants to see the aide* 

AcRdemic/Manarftnent discussion : 

Teacher talks with other adult about individual problems, 
problems with activities, problems with timing* . Either 
facilitating activities or instruction on content may -be 
subject of discussion. 

J oint Teaching : 

Teacher an another adult are working jointl^with the very 
same group of children* Does not inoiude case where aide 
i6 in charge of a Learning Center and teacher comes by, stoppapf. 
to make a comment to the group or to an individual in the 
group* They must have obviously decided to work together. 

Scnuentjp.1 Reports 

Teacher instructs the aide rather than di6cui 6es with the 

aide* Aide reports to teacher and teacher makes a decision 
what to do without discussion* 
Kxarr.pl e ; Aide c omrs up to report that children are almost 
fininhed with the activity. Teacher tell6 her to get them 
started on other work. 

Interaction with /rroup 

Introduces 3>arninf? Center 

This may be adare6sed to whole clas6 or small group* It is 
essentially teacher talk. If one child asks a question and 
teacher addresses explanation to that particular child, t#eh 5 
score below under Act to Individual: Instructs— Hxplains|{ 

Discusses Multiple Abilities 

This refers specifically* to instructions given in the workshop 
to teacher. i)he was supposed to point out the various akills 
involved in each Learning Center and to ask the children 
what skills they thought were involved. She wa's supposed to 
tell them t at no one child would be good at all the abili- 
ties involved in a L # fl #j ,but each one would be good at come. 
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"./J - .. Tia'cher.ObsefVa-Sioa " . ' s . 

, t Guidelines for Scoring * Pa8# 3 

Xf /teacher becomes involved in a diecuoeibn with an 
individual student , score below. „_ 

Example : Teacjher is discuneing multiple abilites involved 
: 'in a measurement task* She asks the children to mention 

• ? some of the abilities they think are involved. One child 

speaks up and names a skill* Teacher; soys, "OK t that % s ^good . " 
Another child names 9 another ability. Teacher says," That's 
a good suggestion that I never would have * thought of. I like 
« the way you are using your imagination. " 

Scoring Example . ' 

Check off teacher lecture under "Discusses Multiple Abil- 
ities • When teacher sneaks to first child,. score act 

in bottom half of sh^et as Act to Individual, Kake a 

*» * 

notation under Evaluation, General Positive. The response 
»\ m to the second child is a second Act to Individual. 

Note under Feedback, Skills because the teacher is making 
her evaluation very specific and is commenting on one 
l>f child •s skills. 

Behavior Management 

Teacher may comment to class or. sub-group about too much noise, 
not settling down at their Learning Centers, too much fooling 
around, not finishing up their activities in good time. She 
may make a general warning, "Some people need to get back to 
. work." In general behavior management refers to reinforcing, 
stating, or sanctioning the basic rule3 for behavior in the 
classroom, particularly those roles necessary for HICA operaxioiii 

Instruction t Content 

Teacher talks to a group about content of MICA math and 
science • May include defining new vocabulary. May include 
asking academic questions of the group. 

, ^ 

* Facilitates Activities : 

Teacher helps students to understand what they have to do to , 

complete activities or worksheets. It does not include academic 

content^ Remark is addressed to a group • Kay talk about some 
difficulties students are having with the activity ,s\ich as 
getting a paper model to siay glued together and how to 
solve those problems. 

Feedback on Prorrrcsn : 

Toacher comments to a group, usually at a Learning Center on 
how they are coming along on their task .May include *a remark on 
their general progress, how well they are working together or 
may be specific to the group 1 s production on the current activil 
or worksheet. 

Be careful here* If remark is distinctly addressed to an indi- 
vidual in the group, score in the Acts to Individuals section. 



130 



Si 



Teacher Observation 
. * Guidelines for Scoring * Page 4 

V 

Acta to Individuals 

«ie section oiT the scoring sheet io exclusive concerned with acts of ' 
ncher addressed to individuals* Each numbered column refers to an 
uninterrupted conversation or speech with a single individual. It may c 
contain several different topics which will all be noted. It may involve 
any number, of ope cif ic interactions between the teacher and that individual 
uttered ^in a sequence. If it is interrupted by a remark to another individual 
"then this particular conversation is at an enal^Move on to the next 
column to score the teacher's remark to another individual* If the teacher 
refers back once more to the first individual and addre;s^re^- another—remark 
-to that persoh, then move on to the 'following, column. Because it has 
been interrupted by interaction with another individual, ix must be scored 
as a new "Talk" to individual. Also, if the teacher interrupts her talk 
to an individual to talk to a group, check off on the top half of scoring 
sheet and proceed. to a new "talk" column whether or not the teacher KKiiliXX 
reeuixmes talking to the same individual. 

flotation system . When scoring teacher talk one must consider several things 
at once: What categories does -this talk contain, i.e. which row should be 
scored? A given Jtalk nay well(and usually doerO contain more than one 
category of content. The second thing to be noted is whether or not this 
student has been talked to on an individual basis by the teacher previously 
in the scoring period. As a new student is contacted or contacts the teacher f _ 
make a check mark on bottom of scoring sheet f so you mny tote up the total _ 
number of different students 'talked tol _ It does r.ot matter whether the 
teacher or the student initiated the contact. The third thine that has 
*to be kept in mind is the language the teacher is using. This is recorded 
^» y sinply; 

When you go to score a cell on the scoring sheet, fill in an 
5 for a remark in Spanish, an S for a remark in English and put in both 
if two languages - re used* You do not need to make any mark aside from tnece_ 
letters in the boxes. If there are a number of rows involved in a single 
conversation, nark each one with ths appropriate letter- for- the —language- 
involved. 

If you score more than 16 units* of conversation or talk, no on to 
the next scoring sheet* Use the top half of the next scoring sheet for 
teacher scores not addressed to individuals rather than go back and forth 
between scoring sheets. 

wanarf-^nt : Disc i r.O. i n e 

This has the same definition as Behavior Management in the top 
scoring section. It efers to reinforcing, stating or -sanctioning 
the basic rules for bahvaior in the classroom, particularly thoso 
behaviors necessary for riCA operation. It d.oes not refer to 
helping the child with activity. It does include the teacher 
telling an individual to "get back to work. H 

Facilitfttes tp Activity ,V orkrheet 

•Same definition as Facilitates in top half of sheet. Must r ef er f 
in thi6 category specifically to KJCA activity , worksheet-(-or work 

— -summary. Be c areful to distinguish it from some substantive 

'remark such as, "Yes, that is a triangle." Score that remark 
under I nstructs : Language:* and Vocabulary , 



ERLC 
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•teacher Observation < Page 5 

Guidelines for Scoring \ 

C 

V»elllt nteHt Finish Vreviou n Vorkaheet 

Thie category is deoigned to catch the teacher's reference to 

work from a previous Learning Center i.e. the worksheet a child- 
either failed to finish or' did net attempt at all. • In the 
teacher's remark must be clear evidence that she has looked for 
or has studied the student's previous worksheet. It will typically 
be combined with feedback on the correctness of responses on 

the worksheet, or with some evaluative remark, wi,th feedback 
on child's progress or with redirecting student back to a Learning 
Center. 

r # 

* Facil itates: Student to Lcnrnir .,T Center 

Teacher either airects * child to a Learning Center to start or 

finish up an activity; or teacher tries to facilitate child g 
choice of which Learning Center he/she should do next, leacher 
may be going over work summary with child and pointing out that 
he/or she still must do several particular Learning Centers, 

Wructs ; Exnlnin . Inform (S ubstantive ) 

This category refers to math science content of the MICA currcculum. 
It is important to distinguish substantive teaching from mere facil- 
itation of activities where . child is to gain t^e substantive under- 
standing from the activities and worksheets themsei^es. 



In structs: Quest i o ns ( Subrtnntive ) t . \ „ , 

— Teacher ask students ouestions in math and science^. They may be 

the questions we provided or the te.acher may be asking her own. 

The teacher is trying to get the student to think about the 
problem at hand. - \ 

Instruc ts: Extend Activity . , 

The teacher is directing the student to extend his act ivity erhaps 

the student is doing the activity at too low a level of cognitive" 
development. Perhaps the teacher things it would be interee.ing and 
informative for student to develop wh^t he/she is doing. 

Talk About: Student Interprets . 

The teacher may ask the student whether some particular activity 
or aspect of an activity interests him.- The teacher may comment 
v that : "You see very" interested in measuring the Monster." 

V. 

Talk About: ' StuHent Skills • 

Skills are broadly defined as the full range of abilities relevant 

to the task. The teacher may ask the. student about skills so as 
to oren the conversation. Be careful to distinguish this "Talk 
About" category from Feedback on Skills. If the teacher go*.». on 
to document what skills the student needs to develop or what 
skills he does particularly well on, in a specific fashion, then it 
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Tencher ObservrAion * P*e« 6 ^ • 

Guidelines' for Scoring 

should aloo be scored as Feedbuck: Skills. 
Talk Abmitt St\id»nt r'*«>lir.^B . 

' Teacher nay be discussing student's behavior with respect to others, 
such aa a ouarrel the child rnay have had during the course of an 
Activity. "Or the student may have shown strong feelings of frustration 
or triumph with respect to ah activity. The teacher is discussing 
these feelings. 

Feedback: ?r/»vious Vorkr-heet 

Teacher is talking specifically about what a .child dio in the 
way of rer.por.ding to the previous'Learning Center's worKeheet . 
She nay be pointing out where a mistake was mace, ohe ray we 
commenting on why she liked the way he answered a particular 
question. The comment must be specific enough to gave the 
child information on exactly what he did right cr wrong and 
why the teacher evaluates -it the way she does. If it is only 
a remark about filling in the missing items, then scQre as 
Facilitates : rr"vio'.»« Worksheet . If remark is evaluative hut 
diffuse or general, score under evaluation « 

Feedback : Current A citivv or WorSsh«et: ' „*> nw ~„n» 

1<cacher specifically lets child know southing about his performance 

on the current activity or worksheet. This feedback must be specific 
enough to act as a guide to some conceivable furture performance. 
For example, "I like the -way you taped that part of toe model. ; 
* this would be sco*red^TS~~thUs category. ^ 
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Fn^f lback: Skills : r . . . ' 

" Teacrer sr.ecifically lets child know something about his skill- or 
abilities". She may tell him he does very well on some specific 
Skills. She nay tell him that he is having problems with nu- -i?lx- - 
, cation ,and procreds to explain just what he did wrong. I* she 
launches into a little\lesson about multiplication, it should 
also be scored under TrWuct : 5x-loin . These are not oust conventional 
subject matter skills, but may refer to skill in observing , nar.i 1 .ulati..g 
reasoning, experimenting etc. t 

Feedback : Oenrral Progress:. . 
~ Teacher nay C o over with the child what he has been able to accomplish 

at various learning Centers. She may or may not use «or* §u— ».y 10. 

this purpose. She may be referring to general progress in learning 
to rend and follow instructions -or manage the worksheets. > 

Feedback: '.Vorkir.r Toother : 

"""Teacher specifically comment* on how child worsts together witn 

others. It may involve ar.king for assistance, offering assistance or 
working as part of a group. Feedback may be negative or positive. 
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. ■ ; ~ : » - - , 

Teacher Obr.ervntipn Peffe^ 
GuideHnae for Scoring 



'c « th.y «. not accompanied 

WLimtinnt G»n»ml Motive • - x and diffur>ft . If the 

' tocher ^oSS^rS. 'h^Ycr ^appropriate behavior, then 
*»°^J** v"^ f T ^nr 8 i:i.efarlir.« . KKmarks such as, 
ecore it under Br.xx ™n r1 wopk# . « You 

•I know you Can do boater, /L^v.-t - aD 1 would be scored 

• ■ have many thine* wrong on your worksheet. aJ.1 woux 



hero. 
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• November. 8,1979- \* 

Additional Guideline* . r*E* 2 

Teacher Oboervation - * 

^ ^ffoifvin/T rf»c\ilinr MICA eventfl * 

Teacher directB kido ab6ut clean up. 4 " 

r ' » • ' .* 

1 ' 'Score : Facilitates: activ^tjes •- . * ♦ 

» - • . 

Teacher- soya to student: Will you go over there and .eh o*^ her how« to 
'do it? « 

'Score: Facilities rStudent to Learning Center 

c. Teacher asks.' student to show her* how he derived answer on worksheet 
She listens to his explanation and say, •"Good, you are right. " 

. < 

' 'Score : Feedback: Current .Worksheet 
* — — — » 

This i3 scored as feedback and not "general positive evaluation" 
because student knows srecif icially which intellectual operation 
was eood'and correct. He can' "use this inforEation ift future 
• performances- calling for .similar ' arithmetic operations. ^ _ 



. MICA -PROJECT 

\ Teacher Observation y * 

Cover Sheet # ~ ,: 

- : Observer 
Teacher . - Observer Ko.^ 



t)ate s * Time' at start 6 of Observation^ 

Number of adults working 'with children* in addition to teacher, 
Week* of Activities with which teacher is engaged. 



Describe below what aides and volunteers are doing relative to the 
teacher ' - 



Code activities of Aide(s) and Label ^aides and volunteers 

A^ A~, etc* C^de activities in categories below at start and 
finisj^f timed observation of teacher- Check as many categories as 
appropriate . 

3-1 

_ L _ ' Non-MICA' 'Activity • * 

Clean-up or Set-up t % 

Working Vn Worksheets or Work Summaries . 

Roving ,\fioni tor ing 

Stationary , • Supervising Group of. Students 

• Taking Observation Notes 

' Talking with Other Adults 



i ■ 



Talking, Instructing, Facilitating Group of . 
. Students 

Interacting w x ^th Individual , Student 



Explain what teacher is doing during the caurse of your observation. 
If some incident occurs which ^commands teacher's attention, describe. 



Comment on noise level, traffic pattern problems, obvious- 'difficulties 
.with materials at particular Learning Center. Note which Learning 
Center is producing a particular problem, if any. 
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TEACHER OBSERVATION 
Cleaning j Coving/Monitoring 



Academic* Task 



-: TCH,*NOT INTERACTING 
Taking Notes — 



Signals^ 



Acac/Mgnt Discussion 



• - — — 






Intro. 
Lrng. Ctr. 


Discusses 
, Multi. Abilsi 


Behavior 
Management 


Instruction 
Content? 


TCHR W/GHOUP 














Feedback on Progress 



1 t2 



Facilitates Activities 



,1 0 



11 



12. 



12. 



il- 



ls. 



TCKR W/INDIV STU 



£TS:. 

nin- 

err 

pted 

:alk 

r/a 

foild 
**** 

>Eng 



DISCIPLINE' 



No. of Diff. Students for Above Acts 

7 . — 5 

^otai No. of Times Spanish Used: 

ERIC_ : . 



Total No. j 

Date: 

Teacher: 



j^,^Observer: 



FACILITATES 



Activ . ; " Wk sheet 



Finish Prev. Wks 



Stu to Learn Ctr 



INSTRUCTS 



Explai:: , Inform (S 



Questions (Subs 4 * 



Lane & Vocab. 



. Extend Activity 



Stu^Interos*.3 S 
Fee 1 i r«c ? 



Stu. Skills 



FEEDBACK 



Previous Wksjreet 



Current Activity 
or Wor?<gheet 



Skills 



Gen. Fro-ress 



Workinc Together 



EVALUATION 



Gen. Postive 



Gen . Nee:- tive 



Ob . * * 



MICA PROJECT 
Whole Class Observation 

Cuid»H r.es for Scoring 

w — 

^ Whole class observations will be scored twice during a visit* You 
will be instructed as to the order in which this instrument will be 
filled out relative to the other instruments* 

This -measure is intended as a quick cross-section of what is 
-going on in the classroom* You must systematically view the class 
so as to locate each 6tuden$ and the adults in the class. If you 
study any one group of children too long they a re likely to change 
grouping pattern or activity; And this will make it difficult for 
you to classify th*m* Put dcwn what they were doing when you first 
saw them and -move on * 

' Before you start : Fill out "the top of the scoring sheet* Count 
how* many children there are in the <class and fill in the blank* Your 
ij^ring on the grid should add up to the total at the top of the sheet* 
If eomeone leaves the., classroom while you are scoring, note 'at bottom 
of scoring sheet* Also, be sure and fill in the names of the Learning 
Centers in Operation at the bottom of the scoring sheet opposite 
letters A,B, C, etc* In your scoring, you will be using the letters to . 
stand for the Learning Centers* 

Definitions : Detailed instructions for scoring are found at the 
bottom of the scoring sheet* There are several definitional problems 
which we will clarify hei*e* 

What is a rroup ? The scoring scheme requires you to distinguish 
between individuals working on separate tasks with others (denoted by \ 
(' ) and an and a group(deonted by ( ) )* A group is defined as more 
^^n one person engaged ft in a collective task* This may be momentary as 
when two children confer over the right answer on the work sheet or 
when one helps the other in understanding an activity* Or it may. be ' % 



Whole Class Observation 

Guidelines for Scoring 
a project on which two children have been assigned to work as a pair. 

^^ie key thing to watch for is interdependence relative to the task, 
2ft will 'include compering botes as they manipulate activities » two 
children manipulating the identical materials with more children 
watching' and commenting, doing th* worksheets together. 

There are come cases that will be hard to distinguish • Following 
are some examples: (l) All the children at a Learning Center ere working 
. on parallel taeks, looking at their own work. There, is occasional talk eft 
you glance at them. Unless you are aura that they are actively discussing 
a task related issue , fce conservative and score as individuals working 
on separate tasks with others. (2) Children are alternately, filling out 
worksheets and discuBsing answers. How you score this depends on what they 
are doing when you first see them. Even though one of them is » for the, 

0^ment 9 engaged in writing and will probably join in the discussion in 
the next moment, put that student down as engaged in individual task of 



writing. v 

Definition .of w in transition on bupin^sa ". We want to distinguish* on 
the one hand, the S who is completely off task from the S who is away from 
a Learning Center activity-engagement but who is doing something related to 
school work such as bringing up worksheets t sharpening pencils * getting Scotch 

tape. On the other hand we want to distinguish this kind of behavior from 

< 

that which is more directly related, to. learning such as manipulating the 
materials. This category should include the child who is watching 'others at 
a learning Center , probably while trying to decide what Center to dq next. 
It ahould also include a child who is talking to the teacher /but not at , 
a Learning Center.* 
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MICA PROJECT 
Whole CUtt Observation 

ACTIVITY 



School _ 
Teacher _ 
Observer 



Engaged st a Learning Center 



Heading 

Writing 



Manip- 
ulative 
Material 

Only 



Talking 
Discuss, 
Task 



Thinking 

Observing 

Listening 



Mixed 

Manip. 

Talking 



Other 
Academic 



Hot Engaged at a Learning C en ter 

In TratM- 
ion (on * 
business) 



Wandering 
Hayinit 
Daydreamln 




[•dividual - 
Hoiking on 
^dividual, 
ttfarate 
ifk alone 
v/others. 



Students 
working on 
I task) 



til group 

irking on 
m task) . 



ejier- larger 
roup (7+) 
rklng on 
sie task) . 



A Instructions: 1) Use nuobers to Indicate no. of children In a giver, category* Use letter to Indicate which 
i Learning Center they are at. Use- ( ) to Indicate a group: Example : (4A) " four children 

working together In a group at Learning Center A. 

2) If an adult is with an Individual or a group indicate with the following appropriate subscripts: 

T ■ teacher A - aide 

Example: (2B)T - teacher working with a pair of cMldren at Learning Center B. 

3) If the students working on the sane task are not f aether physically as a group, but just working 
side by side at a Learning Center or elsewhere, indicate this by usln^ an asterisk (I.e. (6C)*). 

Till in for one of the two observations at a given visit which Learning Centers are In operation. 



S 



A: 


ti 


I: 




I: 


T: 


J: 




C: 


C: 


K: 




D: 


H: 


* L: 





* In ^Transition (on business) Includes S's standing and looking at a Learning Center; also children In transit 
talking to teacher. 
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• 11.9/79 

• MICA PROJECT 
•Target Child Observation 

Guidelines 

W * " 

Tfcie observation has two purpoaes(l) to. examine the implementation 
.'Of the curriculum on an in-depth individual basis and (2) to examine 
.the language u«age of children from three different language groups: 
English dominant; Spanish dominant; and t oee t who have a wenk grasp 
of both languages. 

# » 

The observer will study one child a£ a time in a classroom for 
3 minutes of timed, scoring. Each target* child will have . a cub ject 
number. The order^of observation during a, vist will be pre-determined 
by a random number table. There will be a separate observation 
schedule sheet fox each student for each T minute observation. Each 
3 minute observation is further subdivided into minute and 30 second 
• intervals. 

« 

At the a tart of each observation, before. the timing begins, the 
observer locates the target child Wi fills out the cover sheet 
which contains all the identif ying„-data, a t J description of what the .„ 
Child is doing, and coding catctforea for.,the activity of the target 
Child. After the observation is over you* will want toreturn to the 
cover sheet to fill in more detail on what the child has attempted 
-to do vs a vn KICA activity, * » 

•TIMIVG PROCEEUHSSt J-t is necesanay to have your watch with a second 

«nd, or a stop watch in a p'lace where you can clearly see the seconds, 
ogress. You cannot do this properly if you are standing with a 
clipboard and have ybur watch on your >riat. It makes it much easier 
to keep track. of the seconds if you start ; your observations on the 
minute. If, for some reason \ you have s to 'pause between, 30" " intervals,, 
then waid till 30" has passed and start with the next 30" interval. 

•a- 

UNIT OF CFEKCK CK BEHAVIOR | The timed observation method requires 
checking specific observed behaviors" which occur in the time intervals 
on the code sheet. In coding bp.havior .- as long as that behavior 
io uninterrupted by another type of "behavior listed on the ' code sheet, 
then make orilv one notation per 30" interval.' If that behavior continues 
into the next 30" interval, note it once more in the next time interval. 

In* coding speech , not ate only once until 
that talk is (l) ended by the response of afoot her person; or{~2) ..changes 
into another scorable. category of talk, .If the speech is' long and 
'persists into the next, time .interval, it should be scored once more.^ 
. If the Target Child(T.C) is engaged in a conversation about the MICA 
•ctivity with another child (S), you may score, several speeches even in 
ouch a short interval as 30". Children '^speeches are typically short 
and every time' the. other student speaks, the unit of speech has ended. 
When the T.C. creaks for a second time, it counts, as.^another score. 

» * 

Sometimes you will score in a speech and 
•havior cell' simultaneously, For example if the T.C. is working 
•together with another child and talking" to that other child about 
the tank, note both in the cells "forking, together" and "Task-related 



MICA 

Target Child Observation Page 2 

Guidelines 

ROTATION SYSTEM: The notation system for verbal acta is different than 
that for behavior* Please be careful to note the differences* 

« 

Verb*! S»hnvior : You vill_note that the scoring sheet is 
divided intd three sections: Target Child Talk | Adult Xalk; and 
Target Child Behavior . . You will use ^the following notation system in 
All "Talk" categories | 

To whom is N the actor speaking? Note this with the 
following codes • 

T.C. « Target Child. 
7 ' T « Teacher 

-A « Aide or volunteer 
S m another .student 

8 , « a. pair or more of other students (group) 
Follow this information with a slash(/) 

In what language is the actor speaking? Note this ' r 
with the following codes. 

Sp m Spanish 
\ i E « English 

^ Sp + E m Both- languages 

Examples : Suppose a teacher comes up to the target child you 
are watching and starts talking to him ,helping him wixh the acxivity 
he is doinc* "KerexiiMsannxx Amelia, you are supposed to cut it this way 
and then do the folding, Amelio: I can't get it to stay down when 
I fold it." Teacher: "Maybe you should go g<jt some Sotch Tape." This' 
interchhnge all takes place within a 30" time interval. 

i 

Score The "first teacher speech = T.C./E entered in the 
cell marked Teacher facilitates. The student 
^ _ 'speech is*'» t/E and ,1b entered x in the cell 
marked T.C. TALK: Task Related/ 
„' The..Becond remark of the teacher is scored as 

T9/E and is entered in the sane Teacher -.Facilitate* 
cell as the^ first teacher speech* 
MAKE s SURE YOU UNDERSTAND WHY THIS EXAMiLE IS SCORED IN THIS WAY # 

Non-Ver bal Bfthnvior : F-or this lower jpart of the scoring sheet you 
need only make a check mark in the correct cells. If the behavior is 
intgrrupted but recurrs within 30 h * it is possible to make two chccke 
in a given cell. 

Exampl e :T.C« is watching, a peer at work. He/she pauses to 
take a playful poke at another child who passes by. He/che then turns 
back to continue watching. If this all occurred within 30" f there 

•uld be 2 checks im<the Watches Others Cell and one check in 
#arly Off Task. 



MICA 

Target Child Observation Page 3 

Guidelines 

Detailed description of ADULT TALK categories 

These categories refer ;to_adult verbal acts directed toward the target 
child. If the target child is' part of a group t to whom the adult is 
talkins 9 simply indicate this by putting G/ • Please note, the adult 
does not have, to have initiated the conversation in order for the 
act to be scored in these emails . The child might have coae over 
to the adult and asked a question, or , raised a hand.# If the child \n 
asked a question, thitf should be scored once in the T.C. Task~Relat**d 
Talk Categoriy with the adult listed as the actor to whom, the remark 
was addressed. Secondly it will be scored in the ADULT TALK categories 
when the adult answers v the t child. 

The three types of Teacher or Aide Talk are basically the same 
-distinctions made in the Teacher Observation Instrument . The adult 
la doing the following „ 

Teacher or Aide ?*-cilitr t tes : The adult is helping the 
< ' student ,to understand what they have to do to complete 
f activities or worksheets* It does not include academic 
' r content. Kay include directing a student to a Learning 

Center. May indicate to child how many more items m 
have to be .filled out on worksheet. May read the instruction 
out loud to the child. 

Teacher or Aide Instructs t Teacher or aid^e^ talks about 
centent of HICA. May be trying to extend activity. May 
be helping or reinforcing new vocabulary or assisting 
Kith waiting or spelling on the worksheet. ^May'consist 
of asking the child questions which have the function 
of testing .his understanding or persuading him to 
think about the problem. Do not score as instruct, unless 
this is clearly what the teacher is doing. Jf teacher io 
talking about activity, and you night infer ,sh e has 
- . instructional goal in mind, do not code as instruction 

unless there is definite evidence that, this is the case. 
Otherwide score as facilitate. Instruction in this 
instrument includes Feedback and Evaluation. 

Teacher or Aid*:I)i c ;cipline . This only- refers to attempts 
to control the child's behavior .These attempts do not 
facilitate activity. Please see special note on, this 
-disctinction in tl e addendum to Teacher Observation Instrument 

f . 

'TARGET CHILD TALK CATEGORIES • 
Tftnk'-Relat^ckTalk 

Target Child is talking about his/he* work broadly defined. Any 
^remark relevant to the materials t work sheets* ahould be scored, 
l^wen if the child in talking about oth*r oxperienoen he/fhe has had 
with popcorn, raisins , cameras— *it should be scored. If child in dis- V 
cursing the behavior of other people at the Learning Center or which 
learning, Center it* better, count this an ta.sk-r*lated. If the child 

E 



is responding to an adult's question, the response should be 
scored here. 

Requests Assistance 

Any verbal request for help on reading, with activity, or 

with worksheet should be scored here, 

• - 

Offers Assistance 

- Any verbal indication that child is willing to assist a peer 
on the HICA task, should be scored here. If teacher has directed 
T^C* to go help someone and he/she goes over to of fer -assistance 
(verbally), score here. 

Non-Task Related Talk 

Children may talk about their families, how other children 
behaved at recess, whether or not they like other children, or 
what they are going to do after school today. It should be clearly 
unrelated to IIICA to fall into this category • 

TARGET CHILD BEHAVIOR CATEGORIES 

Clean-up. Child is cleaning up activities at the Learning Center 
or filing papers away. , . + 

-44* 

Works on MICA (alone) 

The operational definition of alone and together is much 
stricter for this instrument than it was for the Whole Class 
Observation. First, any conversation between the children is 
scored above under TALK categories. Secondly, v;e will use a much 
stricter- definitidh of "working together 11 so that if a child is 
clearly at work in MICA, , but not fitting the "working together 11 
criteria, then , score as- working alone. This will include such 
cases as all the children at a Learning Center manipulating their 
own materials and talking about the task. It will also include 
the case .where children are filling out worksheets and occasionally 
announcing what they are putting- down in the way of an answer. 

Works Together with Others . ' 

Wtien the children are working with a single set of materials as 
in a group- project, score in this category. You may also score in 
this category if one student moves over or leans over to manipulate 
another's materials and t^ey are clearly working in a joint fashion 
for at -least this portion of the task.* You may also score if one" 
student is lr^king on as n another works and is discussing With him 
what should bfc done or why it is or isn't being done right. On the 
worksheets, if one child is clearly in conference with T.C. (or 
perhaps,, more than one), over what is the right answer. This is 
distinguished from merely talking about the worksheet. Some kind o 
interdependence for obtaining the answers shbuld be clearly 
observable to be called ^working together. M 
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Page 5. " Tar 9 et child 

Watches Others on Task, Thinking 

Of course you can't tell for sure whether someone is thinking 
^observation. However, the rule is that you should not mark 

TASK unless you have clear grounds for doing so. Thus, if you 
Tre not sure whether child id daydreaming or thinking, you will 
always mark it here. 
Waits for Adult 

Child may follow adult around the room to obtain attention. 
Or aide may be working at the Learning Center with each child, 
in turn. Your T.C. may* be" waiting for his/her turn. 

In Transition (on Business ) 

Child may go to get materials. He/she may be in the process 
of choosing ?he 9 next Learning Center. He/she may take the worksheets 
and walk across the classroom for help. This should be double scored 
as IN TRAxNSITlbNand WAITS FOR ADULT (if there is some waiting). 

Rule: If children are. arguing about material; DO NOT SCORE 

— under verbal categories, but put down here under IN 

TRANSITION. 

• Clearly off Task (MICA) 

In order to score this category you must be quite sure that the 
child is disengaged. Cues include looking at unrelated pictures on 
"S* wall, interferina, teasing or playing with others, wandering 
■^ound the room aimlessly, clearly playing with objects (like a pencil 
Ws opposed to' playful manipulation of MICA activities) . 

olher Academic Work 

We v are only interested in engagement and implementation . ofM 
• mica Therefore, regardless of how engrossed a child la in. unreiatec 
academic wSrk £ ^frequently he/she talks to others about that wor. 
We are not interested. Therefore, regardless of what is being said 
or the level! of engagement, if T.C. is supposed to be doing other 
academic work, continue to score in this category unt^l he/she starts 
doing MICA related activities. 
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MJCA PROJECT* 
Target Child Observation 



Cover Sheet 

Teacher: . 

Student; ' 



Observer^ 
Date: 



Activity, Coding: 

Working at Learning Center Yes No 

* If YES, code activity at Learning Center 

\ 9 Reading or Writing 

\ Manipulating, Material 
\ Talking or Discussing Task 



Manipulating Materials & Talking or Discussing 
Thinking, Observing, Listening 



* If NOT actively working at- Learning Center, code activity 
\ - * Other Academic Work 

\ Waiting Tor Adult 

, j\ In Transition (on business) 

^ \ Clean-up 

; x Wandering, Playing 

. "Grouping Code: Only code, here if.f student is workirig at Learning Center 

' \_ Working Alone 

' , ; Working with Another Student 

o Working in a Small Group (3-6) 

^ Working in a Large Group (7+) 

Briefly describe what child is doing. If at Learning Center, which Learning is it? 
What particular MICA activity is she/he working on? What is he/she attempting to do? 



* Put in A or T beside check mark if Aide or Teacher is clearly supervising the 
CD ^ activity. It should be so obvious that child would know he was being watched. 

.-. '/• . '. ■ . 146 -.. . 



Page 2. 
Teacher 



Student 



Observer] 
Date 



Target Child Observation 



SCORING SHEET 



Target of Talk : T - Teacher; A « Aide^ 

5 ■ Other Student (s).; TC ■ Target Chil 

6 Group of Students 

Language Used : . Sp - Spanish; E English 

Sp + E • Mixture of languages 



Coding Category 



Minute #1 



"1 - 30 



31^ 60- 



Minute #2 



1-30 



31 - 60 



^Minute 03 



1 - 30- 



* 31 - 60 



T»C. TALK 

Task Related 



Request? Assistance 



Offers or Gives 
Assistance 



Non-Task Related 



ADULT TALK TO T.C . 

Teacher:* Facilitates 



^Teacher: Instruction 



Teacher: Discipline 



Aide: Facilitates 



Aide: Instruction 



Aide: Discipline. 



T.C- BEHAVIOR 
Clean-up 



Work9 on MICA (alone) 



Works Together with 
Others 



Watches Others on 
Task, Thinking 



Waits for Adults 



In Transition (on 
business) 



O CLEARLY OFF TASK 
ERLC (MICA) . ; 



;: r^u : _ Z A the A*ade«icuWork I 
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Target Child Observation 



Summary Comments 
Codes 



Teacher 



Student 



. Observer^ 
Date . 



Describe briefly what child has completed at end of observation if working: at 
Learning Center. If child changes activities and location during observation 
period * describe. \ 



If the following was true of- the time of your observation, please check as 
appropriate. Check only if you arc qui :e sure that you can infer this from 
observed behavior. ' ^ 



Child having trouble reading directions or* 
worksheets. .; 

Obtained assistance or figured it out* 
Did not "obtain assistance. 
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3rd Grade 



Overall: 



SES data: 
(Prin)- 



Had a, teacher switch during the course of the activities 

S^ST?^ a f - Cr the u teacher ha ^ rc ^ hcd week 6 or 7 ' 
£w«<n?? a< ^ tlvlties : ?ho aide r£mained- t he same. The 
original teacher and the aide had participated in the 
pre-year MICJ training. The .new teacher had not had that 
^nro! * . ThG T tCadhcC h£d ah ^dividual session with 
i??h P 5???°** coordinator, and was able to discuss problems 
with MICA in her team meetings. She was in the intensive ' 
condition. The first teacher felt a lot of pressure fr^ 
the principal to accomplish her • objectives and MKA ' • 
was seen as a competing element— although it worked in 
a complimentary way, MICA was seen to take away" from time, 

^ C f ly , Spen \° n the task of the objectives. Not- 
withstanding the first teacher was very enthusiastic about 
MICA, as was the second teacher and the aide. The aide 
was sick alot initially. The second teacher followed the 
routines set up by the first/because we requested it. 

"JSLSL*? 6 s J udents ^ this class were on free .or 
reduced lunch. ' 



■Classroom Info: 
(TQ pre MICA) ' 



Teacher Info: 
(TQ pro MICA) 



There were no special .criteria upon- which children 
were assigned to this class. Classroom was self- • 
contained. .* 

From the records (as of 4/10) "for the target kids, 
absenteeism ranged from 0-24 days absent: 2 children 
were out 8 or 9 days; 1 child was absent lfr-days; 
and 2 children .were absent 21-to 24 , days. * 

Shi S5 S i J?"? h0r - had 3 t0 \ yGars tea ?hing oxperionc 
She had used learning centerk in non-core areas 

before (e.-g. health & art). \he second teacher had . 
£ staged -teaching?; this was. her first .assignment. 
Both teachers* and the aide sooke Spanish. The 
first teacher rotated tasks with the aide; with 
the aide » principal responsibility thought of as 
clerical— collecting monies from the students, 
recording grades. The aide occasionally -oave 
original instruction to the large group or in- ! 
dividual students, supervised student work, acted 
to give the teacher information about specific 
student behaviors. ' 



The aide was present for 71/2 hours day. She w 
a credentialed teacher. • 



as not 



!SS in thiS Cla ? S i, Set " u P & Management: Teacher and aide set up 
' ^n^ C ° rded) T ac " viti ^ ^fore the period began; and ? 
comments . cleaned up after it ended. 
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Paciiitation:, jToapher rpy.ed and. monitored; . 
occasionally she worked intensively with an 
individual group of students on a difficult 
concept; sometimes giving* original instruction. 
The aide woirked with individuals on worksheet 
problems* "Most often she stayed- where the more 
difficult activities were located. 

Emphasis on the worksheets: * There was' heavy 
emphasis on the worksheets. The teScher checked 
tevery worksheet fpr spelling errors; and students 
had to-hand them' in to the teacher or aide 
before 4, could proceed to' the next activity. 

Degree of understanding or trouble with the 
activities: Teacher may not have had a flare 
for science, but she went through each of the 
activity panels herself and tried to do the t 
activities by herself at home from the panels 
before the kids used them? eventually^ the .teacher 
and the aide divided up this task of getting 
to H n ow the activities so that it became less 
burdensome and so that the aide .understood raore 
of the -objectives for each task. At first 
neither the teacher nor th*e aide had a high 
degree of understanding and therefore ha,d .some 
trouble with the activities. Soon the teacher 
developed this practice of going through the 
activities, however, and things changed 
dramatically. 

Use of Spanish: Spanish was used by the aide 
and by the teacher regularly to individuals 
and the group as a whole. 
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i»xoCil« s " (School 

» This school had 1 teacher ^ W;*S^T^lSS?- ' • 
OvcraU: g^jfSurlhg the expe.rxment All three P 

' ' fSJSSffi S ftirts^rot- - their own 
ttion of the curriculum, etc. . 

" i . were awarded free or reduced lunch 
,.,f a . 45% of the class were awara- 
SKS data. « 

(Prin lotte • students 

• Tnfo- There, was no particular basis up _ 
Classroom Info. Th^ ^ ^ c s 

J contained classroom. The teac lity 

concerned with giving the chi xar ^ ^ rec ords, 
experience led by ^ teac her absenteeism 
..for the target children in tni ^ 198Q 

_ • ranged from 3 to 13 day* les child was out 5 

out 13 days. . ' • 

' c ^-nori'e'nce in teaching 

- v. r info- Teacher has over 20 years °^P«^ roUnd , She 
■ Teacher Info. Spanish; has a Cuban na 9 ^ corc 

CTQ P^ MIC* has J od xearnin? [ centers for ^> tivities 

activities as well as an cilia flay she 

Math 6 fun). At the beginning fche aldcs . 

plans for that day. and rotate, t 
" Mdes were present 4 hrs/day Neither : JJ-^ ■ 
creden f 1 ^^" "din Ss collecting monies 
for aides were reco "^ h | ldren • s work; and 
for lunch; supervising child: en specific 
providing infonajtxor ; to the teach^ ionally 
behavioral work .issues r t ction and 

a^s."--^^ 1 - needs - . . . 

Tpacher and aides , 
Set-up & ^nageinent: Teacner Aides cleaned 
exclusively set up materials, Aiae 

u Pr • 

racilitation: ^«fr v»rked intensively^ 
with students from 1 or 2 | c ££^ h the . 
a period. Students rotat c^th ^ also 
activities on an «£9J~ 
supervised 1-2 activities 

thesis on Wo^sheets, There 

rch dtv-ionce ^ Ltec a 
remarked upon by the teacher an 

SaTnot^routfno ^ch^rieacher intervened 
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MICA in this class: 



teacher and at Ifeafe £-•<•!' aide, understood the, 
activities very well arid" had little trouble 
with them. The second aide was very quiet and 
it was not clear how. well she understood them" .. 
as a whole; but the one she was working with 
'~ ' < at that moment she understood by virtue of 

' the teacher's explanation, at least. . 

Use of Spanish: Spanish was used regularly to 
the group as a whole and' occasionally to 
individuals. • 

School Profiles (School C) 3rd Grade 

Overall: > The school had 1 teacher and two aides participating in\;- ... 
MICA One teacher and- one of the aides, were trained in 
the MICA pre-year training. The SIP aide was not trained. 
The SIP aide also resented the time, she had to spend on 
MICA "taking a,-/ay" from her SIP work. The MICA activities 
,were set-up and implemented in two ^separate spaces; the 
primary classroom and an empty room down the hall from 
the main classroom. . 

SES data: 17'%' were awarded free lunch or reduced lunch in this class 
(Prin letter) ' 

Classroom Info: There is no particular criterion upon which 
(TO pre MICAV ' children are assigned to this class. There war. 
1 no particular time 1 for MICA; it'was woven in. and 

around Math; the whole class did not do MICA at 
the same time. The class- was self-contained ;, but 
there was an -extra room available in which to set 
. U p mica. Who implemented the activities in which 
* room was/or seemed to be determined by the activity 

type. From the records, for the target children in 
■ ' this class" absenteeism ranged from 4-18 days, as 

of April 1, 1980 2 children were out 4 days; ,1 child 
out 5 days; 4 children wtere out 8-11 days; and 1 . 
. child was out 18 days. 

Teacher Info: The teacher had 6-10 years teaching experience.. She 
(TQ pre MICA) did not speak Spanish; although she had two years 

of Spanish in college and additional Spanish in 
- high school. ' The one SIP aide, also did not speak 
' Spanish; the other aide spoke mostly Spanish and 

little. English.. This other aide was a sqhool 
" administrator from Chile. The teacher had experience 
with learning centers in the past, as a supplement 
to her regular teaching/learning program. 

0 The aide(s) were present forthree hours. There ^ 

were no primary, set responsibilities for the aiaes. 
Tasks were rotated, and everybody did a little 
teaching, a little clerical work, a little diag- 
nostic work, a little supervising of students, ct.c. 



ir 
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« J; »«.««.vv::i«u».j ..•vauci; ..set up tana Ciuanou 
up) the activities before or at the beginning 
of the MICA periods (and at the end) . 

Facilitation: Teacher wandered around the main 
classroom and supervised as needed; the aide 
took a^grAup^in the spare room and worked with 
them oh 4 or so activities; the other aide worked 
with an activity in the main room. 



Emphasis on worksheete: There was some emphasis; 
students often had to finish them at their desks' 
before handing them' into the aide or teacher. 1 
There was no sign-off procedure, but everybody 
was aware of them. 

Use of Spanish: Spanish was never observed in 
use by the teacher to either group or individ- 
uals; by the aide it was occasionally in use. - 
to individuals and only infrequently in use 
to a whole group. 

Degree of Understanding: Teacher and SIP aide 
moderate to lower; Spanish speaking aide Moderate 
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iC, Overall: This school had a consistent 'teacher and aide during the 

activities/ Both -the teacher and the aide were trained 
during the MICA pro-service sessions. 

SES: 84% were awarded free or reduced lunch in this class. 

(P.rin Letter) n \ ■ 6 

o * 
Classroom Info: There is no pa..r titular criterion upon which this 

(TQ pre MICA) class,. obtained students*. The classroom was self- ' m . 

contained, and no- outlets for water; it was in a 

portable* 

Absenteeism ranged from 2 to 19 days out, for the \ 
target kidS, as of 4/1/80.- Five children were out 
* i for- 2 to 4 days; ihreie children were but 17, to" 19 

days. - v ^ 

Teacher Info: This teacher had 1-2 years of previous teaching ar.d 
(TQ pre MICA) experience. Both she and the aide spoke Spanish 

fluently. The teacher had used learning centers 
previously in core areas of science and language 
h arts . , > , 

. The aid,e was present for 6 hrs/day. The, .primary 
V . responsibilities for the aide .w^re supervising 

' " student work and clerical tasks of collecting lunch 

monie&, preparing materials and recording student' 
grades. Occasionally t ; he .aide also presented 
lesr.ons to small groups and ' diagnosed student 
learning needs. The aide never provided large ' , 
group instruction^. '-Tasks were rotated as needed, ' ^ 

based on standard operating procedures, and teacher- / 
teacher &ide consultation* 



/ 



MICA in this class: Set-up & Management: Students set up and 

' cleaned up the activities at the beginning 
(and end) of the period. 

^ * 
Facilitation: Both teacher and aide roamed , 
* and facilitated- as needed--either they noticed 

an issue or* thp., student came up, to them and 
. - requested help! s ' ' 

Emphasis .on worksheets; Students were respons- 
ible for "showing 4 the completed worksheet to the 
.„ teacher before proceeding to the next activity; 

and the teacher or ,aide checked it over then , 
and there-. • 

Degree of understanding: Teacher seemed to have 
" ' a good grasp of the rath activities and soir.e of 

the science activities. On the whole she 
understood the principle behind the activities 
and how to do them. The aide seemed a little 
less clear but had a good understanding 
nevertheless. 

8 - 
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Use of Spanish: Both teacher and aide used 
Spanish regularly to , the students individually 
and as a whole group* [ , 



Othet: Tftis was primarily a student run 
experience. The teacher served "as a stiructurer, 
facilitator and consultant. "Teacher occasionally 
had group introductions N where they went over 
assignment* to activity centers and problems » 
with the activities. 
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Oycrail: Had a teacher switch during, thef course of £he curriculum. 
The first teachcir went through the MICA training session. 
The second teacher did ,not'. She. got some individual 
attention from the' project coordinator and staff. The v 
aide, who had bbeh trained in the MICA session 'earlier 
and who had worked 4 closely, with the first teacher was 
„ able >to help. The first teacher worked with, the students 
. through approximately- v^ek 6.- . 

iSES data: 61% of the students in that class were on free or reduced 
(Prin File) lunch* ,; 



Classroom Info: 
(!TQ pre MICA) 



Students are assigned to this class on a LES 
basis. Both teachers reported trouble getting and 
keeping order • This was als,o noted by the observers, 
Class was in } an open space setting with special 
noise problems to the extent that the school had 
called' in a consultant to work with them on dealing 
with the issues. 



From the records, we can, get some idea of an- 
absentee rate oaly for the target ):ids. The' range 
was from 3 to 20 days; 2 children were, out 3-4 
d£ys; 4 children were out 6-10 days ,and 2 children 
were out 15-20 days. * ' „ 



Teacher Info: 
(TQ pro MICA) 



The first teacher had 6-10 years experience* previous 
to MICA. She spoke Spanish. She had experience 
with learning centers as a source of reinforcement 
for students. -Wanted centers with structure; not 
a free-educational environment* Plans ope day 
ahead for the* next days work. 

The aidb -was present for 6 hours a day in her class. 
The aide was not a tredentialed teacher. Most 
common work modes for the aide previous to MICA w.ore 
supervising student work and feeding information to 
the teacher ? on specific behavioral work issues for" , 
children in the class. The aide never asked to 
diagnose student needs.. The aide occasionally 
recorded grades or collected .JLunch monies ; or t 
prepared a lesson in ESL for a subgroup of children; 
never, did other original instruction. 



MICA in this class; 



Set-up & Management: .Usually done by teacher* 
and aide.** Sometimes students helped. Aides 
and students " cleaned up. \ 

Facilitation: Teacher roved and monitored; \aide 
was usually stationery for a given activity .\ 
Students decided where to go next by what was 
free or' special assignment. \ 




Emphasis- on worksheets:. Had to finish' before 
proceeding; they were not signed off upon . 
however* 

Degree of understanding or trouble with > 
activities:- Firs.t teacher had some trouble, 
but generally understood what had to do; 
second teacher' had much more trouble. 

Use of Spanish: Spanish was used regularly by 
the teacher and aide to., the whole group and 
individuals in the class.. 

Other: The first- teacher was enthusiastic about 
the activities byfe appeared overwhelmed about 
the amount of work they "entailed. c This was 
only increased when the second teacher came 
in. Overall, both teachers were enthusiastic' 
about the project. They wanted a quality 
experience and student cooperation. « 



Overall: Had two aide switches 9 both right at the beginning of the 
year; the same teacher during the course of the yeiir, how- 
ever. Teacher had / een trained in good Spanish; aide 
(final aide) did not speak Spanish. The teacher par ticip?itr : c 
in the training workshop; the final aide had not participate 
(the initial one had) • S 

SES data: 74% of the students in this class were on free or reduced 



tPrin) 



lunch 



Classroom Info: 
(TQ pre MICA) 



Teacher Info: 
(TQ pre MICA) 



Students are assigned to^this class on a LES basis, 
however, some FES students are also added to the 
class on principle. Teacher very particular 
about who worked her students; initially this created 
special project problems later (once tru.st built up) 
t;here was not a problem'. Classroom was self -contoirlec' 

Prom the records (as "of 4/1) for the target kids, 
absenteeism ranged from 0-28 days out: 4 children 
were out 0-4 days, 1 child was out 7 .days; 1 child 
was 'out 12 days; 1 child was out 17 days;- and one 
child was out 2^ days 4 

This teacher had^ 11-20 years of teaching e>;perien^e/ 
She speaks Spanish*; although she may not be native 
to it, she speaks it "well* - She has had experience 
with learning centers for core -learning: language- 
arts and social studies . ' At the beginning of the 
year she figures out the general roles for the * v 
teacher and the aidx*. 

The aide was not a credcntialed teacher. Shn was 
present for 5 hours/day. The aide (final one) did 
not - speak Spanish Principle responsibilities ■ 
were all except , clerical which were done .occasionally . 



MICA in this class: Set-up & Management: Usually done by Teacher, 
(Observers recorded) Aide + 1 or 2 students during latter part,, of 
comments lunch before MICA began; kids & aide cleaned 

up at the, end of the pdriod. 

* ■ 

Facilitation: Teacher began each MICA with & 
group 'session (also ended each session-Cvith a 
group meeting) in a circle where discussed , 
activities, interesting findings and special 
problems. Teacher generally roved a^d monitored 
helping as' needed. If there was a particularly- 
difficult task, they often worked intensely 
with tha*-. group; aide worked with usually a 
selected activity or activitiej; sometimes aide 
would rove. 
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nimhmla on worksheets! Worksheet emphasis vas 

during the^MICA period^ nor 

U^re a marked place in the, class to tum wan 
£? Kid! did work consistently on them, howler, 
and they seemed to be * goal for completion o* 
the .activity. 

Decree of understanding or trouble with the » 
actlvUes: Teacher had a clear understanding 
of the activities; the understanding of the 
aide was very good also. 

tt ~ c^nich- Teacher used Spanish regularly 
tfthe wnSc group and to individual ehildren, 
aide did not speak it. , 

Other:' This class was almost entirely student 
run with the teacher acting as a consultant 
anS facilitate,:. Teacher was very enthusiastic 
about the materials and the pro 3 ect. 
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Overall: 



This school had a teacher and an aide, who were consistent 
over the course* of the, activities. The teacher was 
bilingual in E/S; the aide only spoke Knglish. The 
teacher participated in the prc-year MICA training session; 
the aide did not participate. 

SES data: 81% of the students in that class were on free or reduced 
(Prin letter) ' lunch. >" 



Classroom Info: 
(TQ pre MICA) 



Teacher Info: 
(TQ pre MICA) 



Students were not assigned to this class on any 
specific criterion. Class was in an open space 
seating; noise was a consideration ;<*also a con- 
sidcration was the attractiveness" of the activiti.es 
to the other classes of students in the pod not '* • 
using them.o The fact that students were intrigued 
.by the activities they saw going on in this -class 
irked (or seemed t6 irk) the other non-participating 
teachers in this pod. This was not a serious 
problem, however. ^ 

The records show an absenteeism rate for the target 
children in thi class (as of April, 1980) which 
- varies from 1-24 days; 3 students had'been out l-o 
days; 3 students were out 10,11 days;' and two students 
were out 20-24 days. 

This teacher had 1-2 years .of experience with migrant 
programs before the MICA experience. She spoke 
Spanish. She had experience ,yi th learning centers 
and with sciep.ee; that was the way in which, she 
had hand.lcd the migrant programs (i.e., with Cf3I5-- 
Outdoor biology instruction in Spanish) . She plans 
that morning for the day. • , 

The aide was present- for 6 hours; this aide did not 
speak Spanish. .Tasks were rotated. Primary re- 
sponsibility involved presenting lessons to small 
groups or individual students; supervising student 
work-; recording grades and collecting monies (but 
not preparing materials) ; and providing information 
to the teacher oh specific stuclcnt behaviors. 
Occasionally the aide also provided large group' 
instruction.. The aide never would diagnose for 
individual student learning needs. 



MICA in this class: 



Set-up & Management': 2 or 3 kids set up and 
cleaned up the activities during the recess 
before MICA. 

Facilitation: Teacher roved and monitored and 
answered questions or extended as need be; aide 
sometimes roved and monitored; sometimes 
watched a particular activity; and often 
stayed on sidelines. 



161 



aide did not know it. 

could tell at a glance itemed, why an 
■experiment wasn't or was working. 
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School Profiles (School 0) 



2/3 Grade 



overall- This school had one aide and one teacher, consistently 
Overall. This c ^ ^ ^ activities< Both spokc Spanis h. 

Only the teacher participated in the pre-year MICA training 
session, becasue the aide's family was sick. 

SES data: 93% orf free lunch or reduced lunch 
(teacher) 

Classroom Info: C Students are not assigned to this class on the basis 
Classroom inro. r ^ 8peclal criterion. Classroom was in open . 

space. This did not seem to cause any special 
problems or benefits. The only problem was that 
there was a rug- and the activities using clay and 
the one where they had to mark the footsteps with 
' chalk greatly annoyed the janitor who had to clcr.n 
up the rugs later. This seemed to be enough, of 
an annoyance that future Activities involving clay 
or chalk markings will probably be eliminated 
in their use. 

were not available to us at the school level 
sroom level concerning absenteeism. The 
made an estimate of the amount of absense for 
the target children, .however; according to 
tir.atc, as of April 1, absenteeism ranged 
to 5 days out. Four children 'were never 

2 children were absent approximately once 
or 25 .days. One child was out once or twice 
totalling -approximately 35 days out. ' 

This teacher had 1-2 years of previous teaching ^ 
experience. She spoke Spanish fluently. She haa 
■experience with" learning centers in core suo 3 cct ^ 
areas (e.g. reading) and thought they were tJeqjinwe. 
Generally the teacher decides alone what is to be : 
done in the class or there is a standard operating 
pro/cdurc. The aide does not have any primary 
responsibility. She rotates supervising students, 
doing 'clerical tasks, and serving as an informant 
fdr the teacher on. particular student behaviors. 
The aide is never expected to plan or teach a lesion 
or to diagnose student needs. ( 



Records 
or clas 
teacher 
each of 
this es 
from 0 
absent , 
a week' 
a -week, 



Teacher Info: 
(Pre MICA TQ) 



The af.de was present for 6 hours a day. 
not a credentialed teacher. 



She was 



MICA in this class': 
(Observer recorded) 
comments 



Set-up & Management: Usually done by the aide 
before the actual period), students woula clean 
up themselves after the period was over. Some 
times the children helped set-up too. 
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Facilitation: Teacher roved and helped as * 

needed. Often she stayed, more or less in the 

center and children came to her. The aide 

wandered also; sometimes she was stationcry^with 

a particularly difficult experiment to help 

the kids get through. 

* 

Emphasis 0 on worksheets: There was -moderate 
amount of emphasis on the worksheets . Students 
worked' at center tables to get the worksheets 
complc.ted^ they. then handed them into the 
teacher; tHc teacher did not go over them. 

Degree" of understanding, or trouble with the^ . 
activities: Both teacher and ^aicle had an 
excellent understanding of how the science 
activities A^prked, Whether there was^n ; . 
understanding of the purpose or concept "behind 
the MJCA activities seems questionable. Get't^ujg 
through the acfeivitie^.seemed to be a theme.* 7?" 

JJse of Spanish:. Both teacher and aide used ' 
.Spanish regularly with. both individuals* and the 
grc^up as ,a* wholfe'. % . ' \ . - . " * 

i 

Other: This class was almost entirely student 
run. There was not. any problem for a student 
in figuring out what to "do next or where to 
go next: a standard operating* procedure, had 
been, worked out that "v.orked. ■ 
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ocaouj. rxoiiies IbcnooJL W) 



3rd Grade 



This school had a consitont teacher and aide during tho 
activities. Both the teacher and the aide particiua toe- 
in the pro-year MICA training session. This school v.-a<; 
very slow in implementing the activities, however, and" 
seemed to feel there were great management problems. The 
teacher split up when she used to MICA to fit into a 
number of different pockets during the day and was not 
consistent when she used the activities. 

85% were on reduced or free lunch and qualified for AFDC 

Classroom Info: There was a bilingual criterion used to determine 
(TQ pre MICA) the students for the class. LES . The class was 

self-contained. 

Absenteeism ranged from 0 to 23 days for the target 
students here, as of 4/1/80: 1 student was never 
absent; 1 student was absent for 5 days; 3 students 
were absent for 7-9° days; 1 student was absent for 
14 days* 1 student was absent for 23 days. 

This teacher had 6-10 years of teaching experience. 
Both she and her aide spoke Spanish. She" had had 
experience using learning centers previously in 
curricular areas. 

The aide was present 51/2 hours a day. They 
decided at the beginning of the year how thev 
would divide up the tasks,. Primary responsibilities 
for the aide were planning lessons for ; the whole 
group; supervising work clerical tasks such as . 
collecting lunch monies, and feeding information 
to the teacher concerning particular student ' 
behaviors. Only occasionally would the teacher 
aide present lessons or diagnose student learning 
needs. : 

MICA in this class: Set-up & Management: Teacher and aide set up 

the activities before the actual period. 

Facilitation: Often the whole class did one 
activity which the teacher demonstrated. At 
these times the aide did Kiot participate 
„ except as requested by the teacher. Ac the 

beginning of the activities, students- worked on 
their own and the teacher worked primarily with 
one learning center and the aide with another. 
„ Teacher and aide had to sign off on worksheets , 

so their work with a learning center was 
• generally fitful. 



Ovefall: 



SES-: 
(Prin) 



V 

• \< 

Teacher Info: 
(TQ pre MTCA) 
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Degree of understanding: Both teacher and aide 
had a hard time understanding the activities 
Neither did them at home or pre-read the panel-, 
before introducing thorn to the children; neither 
had a flare for science. . ' r 

Use of .Spanish: Rarely was Spanish used bv 
either teacher or- aide toward the whole group- 
and at most only occasionally was it used by 
the teacher to individuals; the aide rarely 
used Spanish in part because she did not 
interact too much, perhaps. 

Other: This was primarily a teacher-run 
experience. The structure of the class * 
resembled what another whole class instruction 
experience would be like. 



V 
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APPENDIX C 

MINI-TEST PART I *. II 
English 



IKI( 
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No. 

School- 
Grade 
Age 

Teaqher 

i 



Name _^ 

Boy 

Condition 



.Girl 



Section I 

' 4 -II 
III 



Finding Out 
Booklet 



16 



8 



I. DIRECTIONS: Read each word. Choose the picture that 
means the same as the word. Put a big H X" 
on the picture that means the same as the word. 




7, polyshape 







8. test tube, 







9. 




10. sP an 







J 


1 — 
1 

■< 


1 

— y 







D 



9 

1 ERJC 

2 \ S^^^^&^^H 
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.11. cube 






'A 



B 



12. thread 






•B 



13^hexagon 





14. perimeter 



aoongaHaan 
aaoaaasaoa 

gaaOOBBOO 
93QQQSBQB 
5SSQB30QB 

aaaoBBBaO: 

2BBQB99BBI 
2BBBBBBBQI 

SOSC9QSC3QBI 

aeafsasaaBai 



aaaasaa 
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T _ * 



15.- area 























✓ 






✓ 






















































































✓ 















16. symmetry 






I llll 





net weight 






|C £A 




18. f 1 ame ' 











% 




• 




A 






D- 
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DIRECTIONS: o Read each sentence. Choose thfe word that should finish 
the sentence. 



• 




• 






1. 


Milliliters are useful for measuring 


5. Which unit of measurement should you use 
to measure your height? 










A. 


bugs 


A. 


meters ~ K ■ 




B. 


milk 


ft 

6 . 


dec i me ters 




C. 


ycur height 


C. 


centimeters 


— 


D. 


your weight 


n 

u • 


mill i hp to re 

III 1 1 1 1 lUC Kr<Z < J 


2. 


It 


takes about 1 second to 








A. 


eat breakfast 


o. You 


should use millimeters to measure 




3. 


olay baseball 


A. 


your height 






close your eyes 


3. 


your weignt 




C. 


brush ycur :eetr \ 


C. 


the length of ycur desk 




Which of the foTcv/inj is a liqjid? 


D. 


the lengtn of your little finger- 
nail 




A. 


dough 







3. unl.k 

C. salt 

D. measjring cup 



Carol liked to snake jewelry. Her 
mother gave her* seme beacs for Christ- 
mas. Carol decided to count t*e beacs, 
She put them in groups o^ ten. Carci 
discovered sne ha: 63 beads. How r.any 
groups of ten are in 53? 

A. 3 

8. 6 

C. 9 * 

D. % 10 



7. John guessed tnat his foe: was six 
centimeters lor.g. Jonn's guess is 



A. a test 

B. an estimate 

C. an experiment 

D. a measurement 



Jay measured the le.nctn of his pencil 
It was ten centimeters lor.g. Ten 

centimeters is the length 

of the pencil . 

A. actual 

B. guessed 

C. pretend 

0. estimated * 



ERLC 



174 



ii - i 



$. Jill thought she was eighty-seven 
centimeters tall. When her friend 
measured her, she told Jill that she - 

^ was really ninety centimeters tall. 

9 Ninety centimeters is Jill's 

height. 

A. actual 

B. guessed 

C. pretend 

. D. estimated 



iO, Liz wanteSvto know how lone ner hand was. 
Mary measured Liz's hand from the tip of 
her middle finger to her wrist. Mary 
measured the of Liz's hand. 



A. width 

B. heignt 

C. length 

D. tnick.ness 
|\ ^ 

Ann liked to breathe on t.ne car *indcws. 
Then she coula draw pictjres on them wiz.n 
her fingers. What was K Ann putting or. the 
windows? 

A. gas ^ 
8. paper 

C. crayons ^ 

D. moisture 



12. te. Brown wanted to buy carpet for her 
bedroom . She needs to decide hew n:uch 
to buy. What will Ms. Brown need to 
1 fine out? 

A. the. area of the room 

e 

8. the perimeter of the rocn 
C. the height of t.ie room 




D. the volume of tne rpon 



13, VJhich picture shows you how to make an accurate measurement? 




S C 




Tnese liquics are all 

A. acic 

3. base 

• C. neutral 

0. poison 




DIRECTIONS: Look at the three pictures- in order from left*to right. 

Choose the word that best describes what is happening . 
Circle the letter next to your answer. 




B. bounce 

C. arrange 

D. flatten 




The last picture shews tne of Jim's wctk. 



A. pattern 

3. rssjlts 

C. tang ram 

XT. constellation 

. 2 




What word tejls what is happening? 

A. boil 

3. expand 

C. dissolve 

D. concentrate 



f 





^ h *t is happening to the balloon? 

^n*>>f ilt iCexpanding 
£J*** •B/'-it is condensing " 4 
ir-sf ^ -is-betng measured 
*;TD>- -It Is beiiog ^estimated. 




"V 



> 



r 



V 



s 



•STOP i 



5f *••■ 
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DIRECTIONS: Use the pictures to help you answer the quesiti 
Circle the letter next to your answer. 



ons 



10. What do we call these things? 

A. experiment 

B. measurement 
r .. ingredients 
0* carbon dioxide 




21. What is the pot of water putting in the air? 



A. 
B. 
C. 
0. 



acid 
crystal 
moisture, 
negatives 




20 In- the picture Judy is watching :he co!df'««h to 
Anctner words for "watcn" is: . " 



A. occupy 

*B. record 

C. reduce 

0. observe 



i t tr>ey ever tciiCi 62 




4P-\J5 r^m V 




24. Tony built a bridge out of blocks. It was 5 blocks long and 2 blocks wide. Vie call 



these numbers the 

A, , height 

B. symmetry 
C* materials 
D. dimensions 



of the bridge 




25. Julie had drawn several pictures of trees. She decided to glue all her pictures on one 
large piece of cardboard. What was Julie making? 





27. 1 The airplane is flying ,in a certain 



A. shadow 

8., distance 

C. solution 

D. - direction 




1 



. 28. When we say, "Leaves" grow up and roots grow down," we are saying they each grow in a 
*' certain * 

V 

fc.' shadow * . J " . ' / 

distance ' 



C. solution! 
"0. direction 



Tom 1s pouring himself a glass of soda pop (such as coke). It locks like he poured too 
much.. We might say-, "Tlje dpni'has ' 



29. 



• K . A. floated 

B. reflected* 

. j C. "Sepafatecf* 

D. overflowec 




Jill's c;ra,ndmcther was having tnuble reading ;he newspaper. ' She said the letters were 
so small she could not see then/.- To maEe the letters. lock larger JilVs grandmother * 



needs glasses which: 

A. trace 

B. magnify 

C. reflect c 
p. contract 




\ 



31. -Jose was. playing with a rubber-band. He puljed or. the rubberbanrf. and it make" a sound 
me sound was caused by a * * 

, A. , degree • 
B. balance 
<* C. swallow 
D. vibration 
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r 32, Susan and Sandra were playing together, Susan's mother had an idea of something to ao* 
She mixed soap flakes <ind' water together, Susan and Sandra used this mixture to blow 
soap ^bubbles. Another word -for mixture is: 

A;^ location * • . • . 

• 8. solution , 
C* vibration *< » 
D. prediction 



33, The weatherman said it will probably rain tomorrow. He fs' "making a: 




9 

> 



STOP. 



* DIRECTIONS: Read each story. Answer the question. 

'\ • Circle the letter next to your answer, 



36. 



35. Sharon's piant was dying. She did not know why. She thought it light need more 'we te- or 
— maybe it needed more light. First, Sharon decided to try watering tne plant mere' cft*r 
After two weeks the plant was still sick. Sharcn then decided to ~ove the plart to a" 
sunnier window. In a week the plant looked much better. To find out what was "wrorc w<r- 
her plant, what did Sharon do? . - '* 



A. a graph 

B. a recipe 

C. a ir.easure 

D. an experiment 



Mr. Jacob s class was coins exercises every afternoo n. Today he wanted to teac.n «veryon 
a new exercise. To do this exercise e/eryene would need to find one ctner person. to ■ — 
with. Amy and Beth decided to work together. Vie would call them 



work 



A. circular. 

B. ^ partners 

C. " identical 

D. scavengers 



37. Jean ard Susan decided tc ride their ticycles to tne arjestcre. Thev met°at Sus*n'< 
house arc talked abour their bikes. Jean 1 i ke J Susa.n's cic/cle cecause'it wcs"-ed »nd 
had a norn. Jean's Dike was blue ar.c did not nave i ncrn. ' Susan likec Jean's ci<e~ 
because it had a basket and a sof: seat. What were the t*c girls doing with *r~\r~ti<es? 

A. "tracing triers 

5. comparing them 

C. measuring them 

D. diagraming them 



38, Mr. Rodriguez needed to fix the roc-" over his nojse. He was going to Kayo * 0 Cu / a * 
ladder to get up on the reef. Before he went tc the store he went outside and ;cbke-: 
at his nouse to see hew tall it was. Mr. Rodriguez cid rjot have a tape measure but 
he^guessed that he would need to buy a twenty foot ladder. What cc /cu thir.K Mr Rccr'- 
guez did? > , " ' 

A. record 

B. measure 

C. estimate 

D. stretch 



; 1 

39. Joey's family got a new dog which they na.ned "ippy, Joey wanted to keep Tiooy in tn* 
* house at night so he wouldn't be cold, but Joey's dad saic the cog had to stav outsice 
all the time. Joey 'decided to build a house for Tippy, ^is father cave him some weec 
and tools. The first thing Joey needed to do was decide how big the doc ho.s* wcu's 
need to be for Tippy to fit inside of it. How should Jcey do this? " ^ 

A. measure Tippy > 

• Br shorten Tippy 

C. build the house around Tippy <• 

0. build a house and hope it is large enough 

f 
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40. After school JflVwent over to Cecilia's house to play'. When it came time for Jill, to 
walk-home, Cecilia 1 s mother was worried that it would soon start raining. She decided 
it would be a good idea to let Jill wear Cecilia's raincoat to walk home in. How did 
Cecilia's mother decide that Jill and Cecilia were approximately the same size? 



A. she outlined 
3. she recorded 

C. she estimated 

D. x she magnetized 



41. Tom and Alfredo were making chocolate pudding. The directions on the box told then now 
much milk to use. Tom dumped the pudding inthe oowl . What snould Alfredo do before 
he puts the milk in the bowl? 

A. heat it 

B. drink it 

C. weigh it * 

D. measure it 

Al. Ann needed a flashlight to see if her cat was under the house. When she tried to turn 

the flasnlight on, it did not work. ' Ann was not sure what was wrong with the fiasnligr.t. 
Maybe it needeo a new light, 6r maybe it needed rew catteries. Tc find cut, Ann first 
tried new batteries. The flashlight still did ret work so Ann decided it ^us: reec a 
new licnt. To discover wnat was wrong with tr.e fUsr.lignt, «rat did Am do? 

A. a graoo * 

3. a recipe ^ 0 

C. a r.easjre 

D. an experiment 



END OF SECTION II 
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No. 



Nombre 



Escuela 



Nino. 



Nina* 



6ra c do 

i 

Edad - 
Maestro/a 



Condici6n 



LIBRITO PARA 
DESCUBRIMIENTO 



.Parte I 
II 

III 
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1. OIRECCIONES: 



Lee cada palabra. Escoje el dibujo 
que qulere decir 1o mismo que la palabra* 
Pon una M X M grande en el dibujo que 
quiere decir lo mismo que la palabra* 



1. la aguja 







el circuito 







• B 



c 
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11. el cubo 





18. la llama 



c 



II. DIRECCIONES: Pon un cfrculo alredfedor de la palabra o las palabras que mejor 
e contesta la^pregunta: 



# 



Los mililftros son utiles para medir 



A. insectos 

B. la leche 

C. tu altura 

D. tu peso 



5. £Que unidad de medidas deberffs usar 
<,-para medir tu altura? 

A. metros ' 

B. decfmetros 

C. centfmetros 

D. milfmetros 



Uno se tarda como un segundo en 

A. desayunar 

B. . jugar beisbol 

C. cerrar los ojos ^ 

D. lavarse los dientes r 



.3. De los siguientes, icual es un 
liquido? * 

Qf\. masa de harina 

B. la leche 

- C. la sal 

D. una taza para medir 



4* A Carol le gusta hacer joyerfa. Para 
Navidad, su<*mar.icMe regal 6 unas cuen- 
titas. Carol. decidi6cdntarias. Las 
juntfi en grupos de 1Q.>, En total- ella 
corit6 que tenfa 63. Cuantos grupos de 



10/ hay en 63? 



B. '-6 



C. 9 

D. 10 



6. Deb'erfas de usar milffcetros para 
medir 



A. tu altura 

B. tu peso 4 ' 

C. lo largo de tu escritorio 

D. lo largo de la una de tu dedo 
chi co « 



7. Juan adivinoque su pie media seis cen- 
tfmetros. Su adivinanza la llamamos 



A. un examen 

0 

B. una estimaci6n 

C. un experimento 

D. una medida 



Jay midi6 lo largo de su TSpiz. Medfa 
10 centfmetros. 10 centfmetros es el 
largo ^ del 15piz. 

A. real 

B. adivinado 

C. aprendido 

D. estimado 



9. Jill pensfi que medfa 87 centTmetros de 
' *. altura. (Cuando su amiga la medifi, Te 
"dijo que en real i dad medfa SO centT- 
.^-metros. La altura de Jill 
^son los 90 centTmetros. 




1 ' 1 




A., real r> 1 
8. adivinada 




0 

• ■ 


* 


C. fingida 


■ o 






0. estimada 




1 ■; 




.10. Liz querfa saber que largo tenfa ^u mano. 
Mary se la midifi desde Va punta de su 
tercer dedo, hasta la mu.ieca. Mary 
midi6 lo/la de la mano de Liz. 


f 


• < ! 


> 


'_. A. ancho 




- 




° ■ B. . alto ' ft 


< 






C. largo 






- 


0. 4 grueso 








A Ana le.gusta dejar sualiento en las 
ventanas de los carros porque asf puede 
hacer dibujitos con su dedo sobre la 
ventana. £Que es los que estaba dejan- 
do el aliento de Ana sobre el vidrio 
de la. ventana? 


0 


V? 

! . 


' « * 


A. gas 








B« papel 




* 




C. crayolas 




■ 




* ? 0« la humedad 


• 

1 


. > i 


- 


12; -La Srta. Brown querfa comprar una al- 
' # fombra para su dormitorio. Tenia 
' que decidir ctianto comprar. £Que cosa 
tendrS que calcular la Srta. Brown? 
• 


c 

c 


< 

* 


• 


<; - A. el a>ea de su cuarto 






• 


% el 'perfmetro de su cuarto 




* 




la altura de su cuarto 




• 




,0. el vol Omen de su cuarto 
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13. ICuSl dibujo te muestra como hacer una medida exacta ? 




Todos estos Ifquidos son 

A, acidos 

B r bases 

C. neutros 

D. venenosos 




D1RECC10NES:, Mira los tres dibujos en orden de la izquierd* a la derecha* 

: ^ Escoje la palabra que mejor describe lo que est5 pasando, Pon 

un c*rculo alrededor de la* letra al lado de tu respuesta. 



z 

16. 





iCual de estas palabras explicavlo que le ocurre a la pelota? 



A* se^mpapa 

B, Yebota 

C, arregla 
D« se aplana 



17. 







li-4 







El Gltimo dibujo muestra 



del trabajo de Jaime. 



A. el diseno 

B. el resultado 

C. un rompecabezas chino 

D. la constelaci6n 



18. 






iCfial de estas palabras describe lo que estS pasando 



A; hlrviendo 
B« . exparidiendo 
bfr' .disolviendo 
V £lyM . concentrando 
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.19. 




♦iQue.le occure al globo? 



A. se expande 

6. se condensa 

C. esta" siendo medido' 

D. esta" siendo calculado 



STOP 
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DIRECCIONES: Usa los dibujos para contestSr las pregunUu Pon un cfrculo 
alrededor de la letra al lado de tu respuesta. 



iC6mo se llaman estos. qbjetos? 

A, experimento 

B, medi da 

C. ingredientes 

D. bi6xido de carbono 




21. IQui pone la tetera en el a<ire? 



A, acido, 
cristal 

C. humed ( ad 

D. negativos 




En el dibujo j$dy estS mirando los pescaditos para ver si en algun momento se topan 
W Otr< palabra para "mirar" es: 



A, ocupar 

B. registrar 
reducir 

.D, observar " 




23. 



Jose qui ere saber cfimo es que un gusanito se tranforma en mariposa. Puso un gusanito en 
un jarro y lo Va a mira r mientras cambia. dComo puede Jose apren der algo sobra el 



gusanito? 

'A* formandolo 

B. observSndolo 

\ C. calculSndolo 

D- cristalizSndolo 




( 



/ t 



24 Antonio hizo un puente con bloques* Medfa 10 bloques de largo ,y 2 bloques de ancho* 
* Estes son _ del puente, 



A. la altura 

B. la slmetrTa 

C. los materiales 

D. las di mens i ones 




25. Julia dibuj6 varios Srboles. Decidifi pegar todos sus dibujos en un carte!6n grande, 
ZQue cosa estaba haciendo Julia? 



A. un afiche 

B. undisefio 

C* un pentagono 

0. un perfmetro 




26. Para hacer una sombra tienes que tener 



A, luz 

B. zapatos 
€♦ el sol 

D. una cSmara 




27. El avi6n vuela en^una cierta 



A. sombra 

B. distancia 

C. solucion 
0. direccifin 




>8. Cunflo deciiftos que las^hojas crecen hwJrtfWbt, y las naTces hacia abajo", estamos 
dictehdo que cada cual crece en 0 una^C4erta 



•6: 



A # sombra 
B. distancia 
sol uci6n 
direccion. 




•29 TomSs se estS siDd^MQJffl 1 re fresco 
se u el refresco. 

A. flot6 

B. reflej6 

C. separ6 

D. derramtf 




Parece que ech6 mucho, Podrtamos decir c que 



la abuelita de Jill se le estaba haciendo dificil leer el peri6dico. Oijo quejas 
: mraferan tan chicas-que casi no las podia ver. Para que las letras se vean pas 
grandes, la abuelita de Jill necesita anteojos que: 

A. calcan 

B. amplifica'n 

C. reflejan 
0. contrSert 




4 31. 



Jose" jugaba con un eUstico de hule. Lo estir6 y al tocarlo hizo un sonido. El 
sonido fue causado por « 

A. el grado J 

"B. el equilibrio 

C el trago 

D. la vibracion. 




32 Susana y Sandra jugaban juntas. A la mamS de Susana se 1* ocurrtt algo que Podrtan hacer. 
Mezcld jab6n y agua. Susana .y Sandra usaron esta mezcla.para hacer burbujas de jabon. 
Otra palabra para decir mezcla es: 

• A. sitio 
B*- solucifin 

C. vibracifin % 

D. pronfistico 



33. El reportero del tiempo dijo que manana probablemente iba a Hover. El hizo ^ 



A. una cantidad 

B. un pronostico 

C. una estructura 
D» una comparacion 




34. La familia de Jose sal 16 a caminar por el lago, 
mismo. A veces los lagos son como los espejos. 

A. se quiebran 

• B. enfocar. o 

C. se.congelan 

0. reflejan 



Jose mir6 en el lago y se vi6 a el 
Los dos: 




STOP 



\ 



\ 
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DIRECCIONES: 



Lee cada histoHa. Contesta la pregunta.^Pon un circulo al redan 

de la letra al lado de tu respuesta. 

6 



La plantita de Sharon se estaba muriendo. Ella no satoa por que. Pensfi que quiza era 
ooraue hecesitaba mSs agua o mSs luz. Primero Sharon intento darle agua mas a njenudo. . 
aPasaron dos semanas y la plantita todavfa estaba enferma. Entonces Sharon decidio que 
meior oonfa la plantita al lado de una ventana por donde entraba mas sol. En una semana, 
la plantita se mejord muchisimo. iQue fue'lo que hizo Sharon para averiguar lo que 
le pasaba a=su plantita? 



36. 



A. una grSfica 

B. una receta 

C. una medida 

0. un experimento 



La clase del Sr. Jacobo hacfa ejercicios todos las tardes. Hoy.le quena ensenar 
a todo el»mundo un ejercicio nuevo. Para'hacer e'ste ejercicio, cada uno necesitaba 
un companero/a. Amy y Beth decidieron trabajar juntas. Entre los dos formanan 
un/a • 

A. circuUres 

8. pareja 

' C. identicos 

0. mendigos 



Juana y Susana decidieron ir en bicicleta a la farmacia. Se encontraron en casa de 
Susana y se pusieron a platicar acerca de sus bicicletas. A ; Juana le gustaba la 
bicicteta de Susana . por su color rojo y por su bocina. La bicicleta de Juana era 
azuVy no tenia bocina. Pero a Susana le gustaba la bicicleta de Juana porque 
tenia una canasta y un asiento §uavecito. tQue°hacian las ninas al hablar'de sus 
bicicletas? * 

A. calcarlas 

B. compararlas 

C. medirlas 

D. diagramarlas 



38. 



El Sr Rodriguez tuvo que remendar el techo de su casa. Iba a tener que compear una 
escalera para subirse al techo. Antes de ir a la tiendtf salfo para yer que alto tenia 
su casa. Aunque el Sr. Rodriguez no tenfa una cinta para medir la altura, adivinO que 
quizS necesitarta una escalera de 20 pies do altura. cCSmo hizo el Sr. Rodriguez 
para llegar a esta conclusion? , « 

A. anot6 la alturS 

B. mid16.la altura. 

C. hizo una. estimacion de la altura 
0. estirfi la altura * 



201 



39. La familia de Joselito tiene un perrito nuevo que se llama Tipi. Joselito quiere que • 
Tipi se quede en la casa* duranjte la noche para que no Ip-de frfo, pero el PapS de Joselito 
di jo que el perrito tenfa que quedarse afuera todo el tiempo. Joselito deciditf hacerle 
una casita a Tipi.. Su PapS le did madera y herramientas. Lo primero que tenfa *que 
hacer' Joselito era ver de qu§ tamai.o tenfa que ser la casa para que cupiera Tipi, £Qu6 

, ^ podrTa hacer Joselito para calcular el tamaiio? 

A. medir a Tipi 

■* o B. encojer *a Tipi 

C, construir la caia alrededor de Tipi <■ 

D. construir la casa con esperanzas de que sea lo suficientemente grande t 

40. Despues de clases, Jill f ue .a jugar a la casa de^Cecilia. A la hora de que se tenfa 

* que ir Jill a su casa, se preocupo la mama de Cecilia, pensando que quiza iba 5 Hover, 
Decidi6 quealo mejor serfa pre^tarle el impermeable de Cecilia a Jill para que no se 
mojara en el camino. iComo supo la mama de Cecilia que lus ninas eran de casi el 
mismo porte? 

A. lo»trazo 

B % . lo anoto • , 

C. lo calculo 

D. lo magnetizo 

<. • 

4 : . Tom&s y Alfredo estaban haciendo pudffi de chocolate. En la caja Tas indicaciones les 
explicaban cuanta leche usar. TomSs ech6 el polvo del pudfn en un plato hondo. iQue 
deberfa hacer Alfredo antes de echarle la leche al pudfn? 

A* calentarla 

• B. towarsela -> 
C v * pesarla 
D. medirla 



^2. Ana necesitaba jjna linterna para poder Ver si su gato estaba debajo de la casa. Cu?ndo 
encendifi la 1 interna, vi6 que no funcionaba. Pero Aitf no 3Staba segura de lo que le 
pasaba a su linterna. Tal . vez necesitaba un nuevo foco, o quiz! baterias nuevas. Para 
averiguar, Ana primero le" puso baterias nuevas primero. La linterna no funciono, asf 
es que Ana penso que Jo'que necesitaba era un nuevo foco. £Que hizo Ana para averiguar 
que le pasaba as su iinterna? ~~ \ 

■ • . o 



A., una grSfica 

-8. una receta 

C. una medida • 

D. un experimento 



FIN DE LA SECCION II 
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Appendix D 
Sample Worksheets in English & Spanish 
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^Heckt and Sounds 
■SHRl-NK ING RUBBER BAWD 

4 FIELD TEST VERSION 



F-S.-E-16 



;;WV\a+ .happened; 




Haw lonj did the 
extra fc+reng-l'h last? 



A. 



I Hi +he xub ber kjarvd 
"■fcWe :%atne length as 



before — — 

Mow do ubu Knbwf 



- EL £ALOfc ST EL SoNiDO - 

El ELAstjco que. se E^cbJe. 



pK$e> l 




* ■ • 



Uge despv&s del e^teri men-fa? 
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' C hancye and Measurements 
AWCIENT BODY MEAMJRE 



Team 



.« l* r . Person ?er*or> 
The bod<^ mer.sure u>e uaVli use*. . 



OBJfcCT 


1*^ per-soti 1 * 




table f?! 


IO spans ^ ' 


'1 spans ^ . 








<> 

























UlKai" uoe^ found ou+ u>as +Kat» 





CUBIT FATHOM V/IRD HtofclD SPAN foot SPA*/ 



~--^/f£WZ>4 ANT/&UA W. CVBZPh 

Nombrts 

* £ pr — -jm-^z i~&-p—i . 

La. mzdidA. dd cuerpa. que. icsaremas: .un/a. : — 



06JET0 


Mgglt* VB LA 




mesa f?\ 




<\ cuarUs ^7 










f c 
























